-- Logs begin at Fri 2022-06-03 09:11:06 UTC, end at Fri 2022-06-03 10:17:38 UTC. -- Jun 03 09:47:55.930916 dv-cinder-797608-29-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 03 09:47:55.939721 dv-cinder-797608-29-iscsi devstack@n-api.service[103065]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 03 09:47:55.942197 dv-cinder-797608-29-iscsi devstack@n-api.service[103065]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 3 09:47:55 2022] *** Jun 03 09:47:55.942197 dv-cinder-797608-29-iscsi devstack@n-api.service[103065]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 03 09:47:55.942197 dv-cinder-797608-29-iscsi devstack@n-api.service[103065]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 03 09:47:55.942197 dv-cinder-797608-29-iscsi devstack@n-api.service[103065]: nodename: dv-cinder-797608-29-iscsi Jun 03 09:47:55.942197 dv-cinder-797608-29-iscsi devstack@n-api.service[103065]: machine: x86_64 Jun 03 09:47:55.942197 dv-cinder-797608-29-iscsi devstack@n-api.service[103065]: clock source: unix Jun 03 09:47:55.942197 dv-cinder-797608-29-iscsi devstack@n-api.service[103065]: pcre jit disabled Jun 03 09:47:55.942197 dv-cinder-797608-29-iscsi devstack@n-api.service[103065]: detected number of CPU cores: 4 Jun 03 09:47:55.942197 dv-cinder-797608-29-iscsi devstack@n-api.service[103065]: current working directory: / Jun 03 09:47:55.942197 dv-cinder-797608-29-iscsi devstack@n-api.service[103065]: detected binary path: /usr/bin/uwsgi-core Jun 03 09:47:55.942908 dv-cinder-797608-29-iscsi devstack@n-api.service[103065]: your processes number limit is 47680 Jun 03 09:47:55.942908 dv-cinder-797608-29-iscsi devstack@n-api.service[103065]: your memory page size is 4096 bytes Jun 03 09:47:55.942908 dv-cinder-797608-29-iscsi devstack@n-api.service[103065]: detected max file descriptor number: 2048 Jun 03 09:47:55.942908 dv-cinder-797608-29-iscsi devstack@n-api.service[103065]: lock engine: pthread robust mutexes Jun 03 09:47:55.942908 dv-cinder-797608-29-iscsi devstack@n-api.service[103065]: thunder lock: enabled Jun 03 09:47:55.942908 dv-cinder-797608-29-iscsi devstack@n-api.service[103065]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 03 09:47:55.942908 dv-cinder-797608-29-iscsi devstack@n-api.service[103065]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 03 09:47:55.986220 dv-cinder-797608-29-iscsi devstack@n-api.service[103065]: Python main interpreter initialized at 0x55e6566a09c0 Jun 03 09:47:55.986220 dv-cinder-797608-29-iscsi devstack@n-api.service[103065]: python threads support enabled Jun 03 09:47:55.986220 dv-cinder-797608-29-iscsi devstack@n-api.service[103065]: your server socket listen backlog is limited to 100 connections Jun 03 09:47:55.986220 dv-cinder-797608-29-iscsi devstack@n-api.service[103065]: your mercy for graceful operations on workers is 90 seconds Jun 03 09:47:55.986564 dv-cinder-797608-29-iscsi devstack@n-api.service[103065]: mapped 403077 bytes (393 KB) for 2 cores Jun 03 09:47:55.986651 dv-cinder-797608-29-iscsi devstack@n-api.service[103065]: *** Operational MODE: preforking *** Jun 03 09:47:55.986896 dv-cinder-797608-29-iscsi devstack@n-api.service[103065]: *** uWSGI is running in multiple interpreter mode *** Jun 03 09:47:55.986896 dv-cinder-797608-29-iscsi devstack@n-api.service[103065]: spawned uWSGI master process (pid: 103065) Jun 03 09:47:55.987087 dv-cinder-797608-29-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 03 09:47:55.989538 dv-cinder-797608-29-iscsi devstack@n-api.service[103065]: spawned uWSGI worker 1 (pid: 103066, cores: 1) Jun 03 09:47:55.989538 dv-cinder-797608-29-iscsi devstack@n-api.service[103065]: spawned uWSGI worker 2 (pid: 103067, cores: 1) Jun 03 09:47:55.989538 dv-cinder-797608-29-iscsi devstack@n-api.service[103065]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 03 09:47:57.188485 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 03 09:47:57.209653 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 03 09:47:57.912250 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 09:47:57.912250 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: from cryptography.utils import int_from_bytes Jun 03 09:47:57.912587 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 09:47:57.912587 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: from cryptography.utils import int_from_bytes Jun 03 09:47:57.914988 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 09:47:57.914988 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: from cryptography.utils import int_from_bytes Jun 03 09:47:57.915369 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 09:47:57.915369 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: from cryptography.utils import int_from_bytes Jun 03 09:48:00.513357 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 03 09:48:00.513922 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 03 09:48:00.514149 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 03 09:48:00.514514 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 03 09:48:00.514769 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 03 09:48:00.515005 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 03 09:48:00.515361 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.515443 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 03 09:48:00.515530 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.515775 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.515868 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 03 09:48:00.516092 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.516185 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 03 09:48:00.516379 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 03 09:48:00.516477 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.516715 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.516805 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.517035 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.517119 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.517352 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.517436 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.517680 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.517812 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.517961 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.518057 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.518277 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.518370 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.518601 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-29-iscsi {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.518698 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.518925 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.519021 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.519231 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.519315 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.519538 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.519622 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.520399 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.520505 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.520704 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.520796 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-29-iscsi {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.521024 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.521134 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.521333 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.521429 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.521643 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.521859 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.521997 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.522310 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.522450 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.522616 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.522708 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.522923 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.523016 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.523260 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.523427 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.523604 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.523728 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.523889 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.524030 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.524209 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.524341 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.524517 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.524678 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.524843 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.524996 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.525153 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.525307 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.525548 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-29-iscsi {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.525646 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.526141 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.526292 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.526459 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.526563 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.526773 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.526870 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.527185 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.527326 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-29-iscsi {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.527497 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.527667 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.527799 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.527968 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.528115 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.528291 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.528438 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.528684 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.528769 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.529000 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.529085 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.529313 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.529400 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.529637 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.529729 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.529990 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.530090 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.530290 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.530374 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.530600 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.530695 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.530907 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.531002 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.531225 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.531317 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.531530 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.531624 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.531833 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.531930 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.532079 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.532171 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.532387 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.532473 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.532707 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.532801 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.533026 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.533120 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.533330 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.533413 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.533580 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.533677 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.533987 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.534076 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.534173 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.534253 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.534484 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.534571 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.534792 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.534877 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.535102 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.535218 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.535395 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.535481 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.535718 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.535802 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.536021 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.536117 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.536327 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.536412 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.536633 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.536716 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.536938 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.537035 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.537246 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.537337 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.537555 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.537639 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.537886 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.537990 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.538197 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.538282 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.538549 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.538644 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.538876 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.538968 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.539189 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.539279 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.539499 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.539585 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.539806 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.539890 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.540128 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.540219 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.540438 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.540530 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.540754 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.540849 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.541063 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.541156 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.541369 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.541469 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.541676 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.541786 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.542013 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.542098 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.542335 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.542440 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.542655 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.542740 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.542957 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.543049 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.543206 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.543300 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.543508 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.543592 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.543812 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.543898 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.544128 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.544221 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.544433 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.544524 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.544696 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.544779 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.545001 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.545099 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.545309 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.545405 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.545610 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.545700 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.545947 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.546034 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.546250 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.546334 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.546555 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.546638 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.546857 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.546942 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.547160 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.547252 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.547465 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.547561 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.547769 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.547853 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.548072 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.548172 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.548376 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.548473 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.548681 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.548771 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.548984 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.549070 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.549286 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.549379 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.549587 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.549671 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.549918 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.550006 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.550239 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.550334 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.550543 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.550626 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.550870 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.550968 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.551185 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.551279 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.551488 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.551579 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.551795 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.551883 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.552102 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.552199 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.552409 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.552500 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.552715 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.552801 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.553022 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.553115 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.553320 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.553411 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.553626 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.553710 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.553958 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.554060 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.554265 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.554356 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.554570 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.554665 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.554871 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.555028 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.555172 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.555256 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.555477 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.555562 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.555783 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.555869 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.556086 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.556178 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.556391 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.556486 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.556689 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.556773 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.556995 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.557082 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.557307 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.557392 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.557613 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.557698 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.557944 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.558029 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.558248 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.558341 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.558568 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.558662 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.558888 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.558971 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.559202 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.559294 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.559512 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.559596 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.559821 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.559906 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.560143 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:48:00.560241 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.560483 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.560569 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.560802 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.560886 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.561115 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.561207 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.561430 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.561525 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.561792 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.561891 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.562099 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.562185 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.562413 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.562499 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.562726 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.562811 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.563044 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.563127 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.563362 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.563454 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.563679 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.563771 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.563995 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.564081 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.564310 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.564404 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.564629 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.564714 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.564938 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.565029 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.565256 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.565348 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.565575 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.565658 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.565918 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.566006 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.566230 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.566313 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.567063 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.567170 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.567392 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.567479 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.567717 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.567800 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.568041 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.568131 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.568356 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.568445 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.568665 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.568758 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.568976 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.569069 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.569286 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.569377 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.569607 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.569703 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.569966 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.570068 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.570280 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.570366 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.570591 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.570675 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.570902 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.570995 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.571215 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.571300 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.571526 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.571610 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.571849 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.571940 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.572158 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.572242 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.572474 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.572559 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.572790 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.572875 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.573104 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.573188 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.573416 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.573498 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.573730 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.573843 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.574072 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.574155 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.574386 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.574472 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.574700 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.574785 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.575006 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.575090 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.575312 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.575397 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.575618 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.575704 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.575928 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.576014 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.576234 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.576381 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.576543 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.576628 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.576854 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.576945 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.577162 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.577254 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.577478 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.577561 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.577811 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.577931 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.578127 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.578335 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.578433 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.578515 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.578738 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.578845 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.579043 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.579151 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.579356 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.579454 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.579668 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.579764 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.579971 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.580077 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.580284 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.580379 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.580593 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.580690 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.580896 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.581006 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.581210 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.581311 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.581514 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.581608 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.581851 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.581939 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.582239 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.582843 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.583033 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.583126 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.583346 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.583432 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.583652 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.583736 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.583960 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.584053 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.584279 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.584372 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.584591 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.584676 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.584905 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.585000 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.585220 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.585305 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.585536 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.585621 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.585877 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.585982 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.586197 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.586280 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.586519 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.586613 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.586833 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.586935 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.587142 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.587226 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.587454 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.587540 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.587764 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.587850 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.588072 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.588156 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.588381 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.588491 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.588694 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.588800 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.589000 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.589097 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.589307 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.589412 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.589613 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.589710 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.589944 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.590053 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.590255 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.590350 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.590561 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.590657 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.590872 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.590968 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.591175 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.591292 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.591480 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.591575 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.591787 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.591875 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.592116 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.592227 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.592422 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.592508 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.592727 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.592815 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.593038 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.593136 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.593347 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.593434 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.593693 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.593809 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.594027 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.594131 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.594340 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.594426 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.594652 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.594747 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.594966 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.595054 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.595277 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.595364 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.595589 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.595676 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.595910 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.595997 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.596221 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.596306 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.596538 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.596634 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.596847 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.596936 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.597158 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.597247 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.597468 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.597555 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.597835 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.597943 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.598143 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.598228 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.598459 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.598560 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.598787 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.598891 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.599101 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.599189 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.599421 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.599515 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.599727 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.599821 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.600043 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.600137 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.600362 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.600459 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.600675 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.600762 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.600987 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.601073 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.601299 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.601392 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.601611 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.601707 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.601963 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.602051 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.602276 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.602376 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.602592 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.602687 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.602901 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.602986 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.603215 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.603314 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.603522 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.603616 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.603837 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.603922 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.604139 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.604225 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.604452 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.604542 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.604776 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.604862 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.605091 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.605179 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.605404 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.605490 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.605709 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.605808 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.606050 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.606139 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.606358 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.606442 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.606671 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.606771 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.606983 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.607071 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.607289 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.607375 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.607594 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.607758 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.607906 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.608000 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.608214 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.608307 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.608521 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.608620 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.608829 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.608924 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.609132 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.609217 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.609442 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.609537 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.609772 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.609862 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.610073 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.610161 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.610377 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.610474 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.610683 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.610769 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.611000 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.611094 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.611309 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.611395 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.611613 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.611711 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.611922 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.612009 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.612237 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.612361 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.612539 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.612625 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.612862 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.612948 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.613173 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.613269 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.613504 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.613592 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.613833 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.613926 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.614142 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.614239 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.614469 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.614556 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.614780 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.614874 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.615085 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.615178 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.615391 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.615476 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.615699 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.615795 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.616006 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.616101 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.616323 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.616410 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.616634 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.616793 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.616945 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.617039 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.617266 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.617353 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.617578 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.617674 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.617922 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.618010 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.618235 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.618334 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.618546 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.618640 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.618856 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.618951 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.619168 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.619257 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.619478 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.619565 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.619788 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.619874 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.620100 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.620185 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.620407 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.620494 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.620711 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.620798 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.621022 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.621108 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.621335 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.621435 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.621652 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.621933 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.622036 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.622271 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.622358 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.622583 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.622677 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.622900 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.622993 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.623222 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.623465 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.623560 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.623806 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.623894 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.624129 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.624225 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.624455 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.624543 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.624781 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.624878 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.625092 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.625185 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.625400 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.625488 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.625706 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.625806 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.626044 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.626132 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.626350 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.626450 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.626657 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.626757 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.626964 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.627062 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.627272 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.627369 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.627578 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.627666 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.627883 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.627970 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.628189 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.628289 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.628492 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.628587 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.628807 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.628939 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.629624 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.629712 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.629964 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.630053 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.630271 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.630359 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.630590 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.630677 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.630896 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.630982 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.631202 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.631290 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.631506 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.631602 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.631811 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.631906 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.632137 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.632223 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.632450 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.632585 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.632760 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.632848 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.633068 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.633165 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.633379 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.633466 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.633719 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.633882 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.634052 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.634150 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.634378 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.634473 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.634686 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.634773 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.634994 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.635090 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.635299 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.635401 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.635612 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.635698 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.635922 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.636020 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.636227 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.636321 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.636540 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.636626 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.636849 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.636984 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.637158 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.637243 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.637467 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.637553 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.637790 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.637897 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.638109 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.638196 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.638416 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.638502 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.638728 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.638823 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.639037 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.639141 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.639342 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.639428 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.639642 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.639728 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.639952 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.640037 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.640300 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.640403 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.640562 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.640649 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.640867 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.640953 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.641168 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.641268 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.641480 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.641566 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.641803 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.641892 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.642114 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.642212 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.642416 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.642537 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.642724 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.642814 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.643032 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.643131 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.643339 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.643426 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.643645 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.643740 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.643956 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.644044 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.644259 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.644344 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.644564 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.644681 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.644925 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.645021 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.645227 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.645314 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.645533 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.645619 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.645868 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.645961 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.646176 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.646275 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.646491 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.646586 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.646793 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.646880 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.647100 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.647192 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.647403 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.647498 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.647710 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.647798 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.648014 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.648102 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.648322 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.648418 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.648627 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.648723 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.648930 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.649025 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.649236 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.649341 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.649539 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.649625 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.649861 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.649961 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.650184 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.650279 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.650491 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.650577 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.650795 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.651128 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.651351 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.651437 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.651654 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.651749 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.651980 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.652067 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.652293 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.652388 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.652601 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.652688 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.652912 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.653008 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.653219 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.653308 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.653546 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.653631 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.653884 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.653974 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.654197 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.654285 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.654512 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.654606 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.654817 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.654913 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.655132 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.655219 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.655444 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.655531 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.655757 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.655856 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.656059 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.656146 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.656363 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.656449 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.656677 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.656773 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.656987 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.657075 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.657300 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.657394 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.657606 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.657703 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.657956 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.658044 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.658281 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.658372 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.658595 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.658700 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.658891 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.658986 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.659203 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.659296 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.659512 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.659600 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.659822 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.659917 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.660133 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.660717 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.660971 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.661059 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.661284 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.661380 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.661596 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.661693 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.661936 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.662022 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.662248 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.662336 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.662560 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.662653 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.662867 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.662955 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.663177 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.663271 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.663478 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.663592 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.663791 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.663878 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.664099 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.664194 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.664402 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.664500 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.664711 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.664797 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.665013 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.665099 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.665325 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.665422 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.665629 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.665717 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.665958 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.666087 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.666272 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.666404 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.666579 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.666719 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.666892 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.667025 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.667198 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.667334 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.667622 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.667709 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.667936 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.668021 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.668250 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.668338 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.668556 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.668643 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.668874 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.668969 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.669191 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.669286 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.669510 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.669598 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.669855 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.669947 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.670169 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.670258 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.670469 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.670591 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.670782 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.670908 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.671108 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.671224 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.671413 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.671539 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.671717 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.671847 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.672021 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.672152 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.672343 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.672469 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.672654 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.672798 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.672983 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.673101 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.673397 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.673487 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.673700 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.673817 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.674093 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.674199 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.674344 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.674428 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.674671 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.674765 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.675037 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.675121 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.675359 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.675444 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.675682 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.675768 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.676550 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.676642 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.676862 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.676960 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.677176 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.677267 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.677486 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.677577 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.677832 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.677940 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.678161 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.678250 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.678473 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.678562 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.678788 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.678893 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.679093 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.679181 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.679417 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.679505 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.679739 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.679834 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.680053 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.680148 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.680372 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.680458 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.680677 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.680786 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.681002 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.681106 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.681329 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.681418 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.681647 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.681735 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.681998 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.682097 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.682348 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.682436 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.682661 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.682748 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.682972 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.683125 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.683279 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.683368 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.683586 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.683673 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.683909 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.683999 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.684216 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.684305 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.684531 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.684618 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.684838 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.684925 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.685146 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.685231 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.685453 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.685549 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.685778 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.685870 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.686089 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.686177 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.686394 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.686480 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.686706 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.686801 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.687015 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.687105 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.687323 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.687425 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.687644 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.687739 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.687950 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.688036 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.688269 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.688365 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.688582 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.688678 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.688888 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.688977 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.689195 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.689292 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.689502 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.689590 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.689846 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.689949 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.690164 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.690265 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.690475 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.690563 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.690784 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.690871 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.691093 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.691182 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.691419 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.691515 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.691756 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.691842 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.692134 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.692366 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.694140 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.696009 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.696237 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.696325 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.696423 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.696507 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.696587 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.696675 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.696756 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.696845 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.696926 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.696926 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.697071 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.697157 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.697238 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.697326 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.697413 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.697531 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.697612 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.697704 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.697806 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.697902 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.697984 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.698063 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.698141 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.698219 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.698298 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.698386 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.698467 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.698555 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.698635 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.698713 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.698800 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.698880 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.698959 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.699037 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.699115 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.699192 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.699279 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.699360 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.699438 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.699524 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.699616 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.699704 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.699794 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.699874 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.699961 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.700042 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.700119 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.700198 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.700354 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.700455 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.700814 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.700919 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.701006 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.701096 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.701331 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.701422 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.701658 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.701786 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.701994 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.702134 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.702309 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.702396 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.702627 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.702725 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.702940 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.703041 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.703260 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.703354 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.703576 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.703663 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.703883 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.703978 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.704201 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.704288 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.704515 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.704617 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.704825 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.704922 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.705145 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.705341 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.705467 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.705674 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.705791 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.706032 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.706319 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.706419 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.706653 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.706739 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.706970 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.707068 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.707814 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.707906 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.708130 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.708220 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.708443 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.708532 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.708758 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.708854 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.709073 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.709169 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.709392 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.709481 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.709708 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.709846 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.710053 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.710229 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.710389 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.710476 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.710708 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.710805 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.711028 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.711129 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.711345 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.711433 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.711661 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.711756 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.711979 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.712067 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.712300 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.712389 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.712612 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.712699 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.712927 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.713016 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.713251 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.713386 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.713568 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.713667 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.713908 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.713998 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.714220 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.714306 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.714536 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.714641 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.714847 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.714933 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.715158 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.715254 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.715468 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.715566 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.715782 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.715869 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.716093 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.716187 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.716402 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.716489 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.716721 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.716816 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.717040 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.717135 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.717350 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.717439 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.717665 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.717780 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.718008 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.718105 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.718355 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.718527 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.718673 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.718846 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.719181 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.719336 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.719507 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.719833 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.719920 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.720153 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.720248 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.720469 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.720566 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.720797 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.720885 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.721105 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.721194 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.721412 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.721501 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.721724 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.721877 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.722059 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.722149 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.722367 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.722467 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.722675 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.722806 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.723571 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.723673 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.723880 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.723968 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.724190 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.724277 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.724501 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.724597 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.724820 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.725034 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.725132 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.725380 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.725468 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.725698 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.725807 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.726052 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.726300 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.726397 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.726653 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.726748 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.726975 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.727069 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.727299 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.727386 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.727606 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.727694 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.727911 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.727999 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.728229 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.728318 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.728540 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.728629 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.728846 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.728933 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.729152 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.729239 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.729463 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.729552 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.729790 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.729881 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.730098 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.730197 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.730409 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.730499 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.730714 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.730809 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.731042 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.731138 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.731347 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.731435 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.731651 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.731739 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.731956 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.732053 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.732267 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.732355 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.732573 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.732670 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.732876 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.732977 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.733183 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.733270 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.733490 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.733623 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.733825 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.733915 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.734133 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.734219 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.734440 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.734526 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.734741 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.734829 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.735051 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.735139 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.735356 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.735441 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.735664 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.735752 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.735970 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.736057 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.736285 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.736380 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.736595 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.736685 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.736904 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.736990 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.737221 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.737307 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.737533 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.737622 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.737881 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.737973 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.738190 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.738297 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.738524 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.738619 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.738864 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.738951 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.739177 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.739273 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.739497 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.739713 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.739802 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.740053 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.740140 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.740381 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.740470 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.740717 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.740976 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.741063 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.741318 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.741416 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.741642 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.741728 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.741977 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.742075 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.742307 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.742396 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.742621 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.742717 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.742930 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.743017 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.743239 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.743327 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.743557 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.743683 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.743868 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.743956 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.744183 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.744271 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.744491 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.744578 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.744805 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.744906 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.745115 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.745201 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.745425 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.745512 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.745736 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.745895 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.746072 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.746160 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.746383 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.746468 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.746698 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.746795 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.747014 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.747102 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.747329 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.747424 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.747645 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.747734 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.747963 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.748056 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.748280 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.748376 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.748594 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.748692 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.748906 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.748993 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.749217 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.749305 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.749530 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.749618 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.749872 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.749964 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.750188 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.750284 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.750503 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.750592 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.750806 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.750893 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.751123 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.751223 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.751458 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.751547 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.751778 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.751873 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.752089 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.752191 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.752440 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.752527 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.752765 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.752852 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.753091 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.753188 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.753411 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.753507 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.753734 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.753881 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.754094 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.754185 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.754420 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.754508 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.754737 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.754824 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.755064 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.755156 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.755378 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.755466 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.755682 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.755778 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.755990 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.756078 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.756298 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.756387 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.756610 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.756708 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.756930 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.757026 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.757241 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.757329 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.757547 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.757645 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.757956 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.758047 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.758283 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.758372 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.758587 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.758698 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.758895 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.758991 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.759198 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.759284 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.759500 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.759587 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.759805 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.759890 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.760106 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.760191 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.760408 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.760496 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.760711 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.760798 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.761014 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.761100 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.761316 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.761412 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.761620 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.761707 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.761951 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.762040 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.762256 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.762344 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.762559 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.762645 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.762861 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.762963 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.763165 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.763262 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.763468 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.763554 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.763776 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.763873 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.764083 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.764171 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.764390 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.764480 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.764694 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.764796 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.765025 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.765121 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.765349 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.765437 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.765661 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.765777 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.766011 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.766110 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.766329 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.766417 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.766642 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.766729 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.766954 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.767051 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.767277 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.767363 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.767586 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.767673 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.767899 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.767985 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.768210 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.768335 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.768520 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.768608 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.768833 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.768931 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.769144 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.769233 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.769457 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.769552 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.770319 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.770408 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.770627 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.770727 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.770940 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.771027 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.771262 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.771356 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.771586 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.771684 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.771893 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.771979 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.772205 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.772292 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.772535 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.772632 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.772850 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.772938 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.773161 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.773248 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.773477 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.773572 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.773807 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.773897 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.774125 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.774214 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.774439 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.774565 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.774752 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.774846 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.775066 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.775199 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.775383 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.775473 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.775690 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.775776 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.776261 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.776359 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.776586 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.776672 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.776915 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.777009 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.777230 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.777392 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.777559 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.777655 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.777909 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.777999 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.778227 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.778329 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.778558 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.778702 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.778844 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.778931 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.779073 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 03 09:48:00.779215 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.779535 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.779854 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.780164 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:48:00.780408 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 03 09:48:00.837236 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: INFO dbcounter [None req-abb29518-2e8e-419f-bf4e-228401394252 None None] Registered counter for database nova_api Jun 03 09:48:00.838739 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: INFO dbcounter [None req-23ba7858-025b-49dc-9fd9-2e8af91c9ce5 None None] Registered counter for database nova_api Jun 03 09:48:00.858910 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG oslo_db.sqlalchemy.engines [None req-abb29518-2e8e-419f-bf4e-228401394252 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103067) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 09:48:00.860735 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG oslo_db.sqlalchemy.engines [None req-23ba7858-025b-49dc-9fd9-2e8af91c9ce5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103066) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 09:48:00.866496 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG dbcounter [-] [103067] Writer thread running {{(pid=103067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 09:48:00.868131 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG dbcounter [-] [103066] Writer thread running {{(pid=103066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 09:48:00.922292 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.context [None req-abb29518-2e8e-419f-bf4e-228401394252 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2c987095-b86e-48e2-b785-0c700e5d563a(cell1) {{(pid=103067) load_cells /opt/stack/nova/nova/context.py:464}} Jun 03 09:48:00.924256 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.context [None req-23ba7858-025b-49dc-9fd9-2e8af91c9ce5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2c987095-b86e-48e2-b785-0c700e5d563a(cell1) {{(pid=103066) load_cells /opt/stack/nova/nova/context.py:464}} Jun 03 09:48:00.926842 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG oslo_concurrency.lockutils [None req-abb29518-2e8e-419f-bf4e-228401394252 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:48:00.928390 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG oslo_concurrency.lockutils [None req-abb29518-2e8e-419f-bf4e-228401394252 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:48:00.928866 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG oslo_concurrency.lockutils [None req-23ba7858-025b-49dc-9fd9-2e8af91c9ce5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:48:00.929175 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG oslo_concurrency.lockutils [None req-abb29518-2e8e-419f-bf4e-228401394252 None None] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:48:00.930460 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG oslo_concurrency.lockutils [None req-23ba7858-025b-49dc-9fd9-2e8af91c9ce5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:48:00.931140 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG oslo_concurrency.lockutils [None req-abb29518-2e8e-419f-bf4e-228401394252 None None] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103067) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:48:00.931384 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG oslo_concurrency.lockutils [None req-23ba7858-025b-49dc-9fd9-2e8af91c9ce5 None None] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:48:00.933124 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: INFO dbcounter [None req-abb29518-2e8e-419f-bf4e-228401394252 None None] Registered counter for database nova_cell0 Jun 03 09:48:00.933338 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG oslo_concurrency.lockutils [None req-23ba7858-025b-49dc-9fd9-2e8af91c9ce5 None None] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:48:00.935368 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: INFO dbcounter [None req-23ba7858-025b-49dc-9fd9-2e8af91c9ce5 None None] Registered counter for database nova_cell0 Jun 03 09:48:00.937094 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: INFO dbcounter [None req-abb29518-2e8e-419f-bf4e-228401394252 None None] Registered counter for database nova_cell1 Jun 03 09:48:00.939329 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: INFO dbcounter [None req-23ba7858-025b-49dc-9fd9-2e8af91c9ce5 None None] Registered counter for database nova_cell1 Jun 03 09:48:00.945432 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG oslo_db.sqlalchemy.engines [None req-abb29518-2e8e-419f-bf4e-228401394252 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103067) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 09:48:00.947247 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG oslo_db.sqlalchemy.engines [None req-abb29518-2e8e-419f-bf4e-228401394252 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103067) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 09:48:00.948747 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG oslo_db.sqlalchemy.engines [None req-23ba7858-025b-49dc-9fd9-2e8af91c9ce5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103066) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 09:48:00.952859 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG oslo_db.sqlalchemy.engines [None req-23ba7858-025b-49dc-9fd9-2e8af91c9ce5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103066) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 09:48:00.953174 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG dbcounter [-] [103067] Writer thread running {{(pid=103067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 09:48:00.954677 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG dbcounter [-] [103066] Writer thread running {{(pid=103066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 09:48:00.955197 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG dbcounter [-] [103067] Writer thread running {{(pid=103067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 09:48:01.096653 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG dbcounter [-] [103066] Writer thread running {{(pid=103066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 09:48:01.100062 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: INFO dbcounter [None req-abb29518-2e8e-419f-bf4e-228401394252 None None] Registered counter for database nova_cell0 Jun 03 09:48:01.105678 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: INFO dbcounter [None req-23ba7858-025b-49dc-9fd9-2e8af91c9ce5 None None] Registered counter for database nova_cell0 Jun 03 09:48:01.107717 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG oslo_db.sqlalchemy.engines [None req-abb29518-2e8e-419f-bf4e-228401394252 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103067) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 09:48:01.112233 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG dbcounter [-] [103067] Writer thread running {{(pid=103067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 09:48:01.112384 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG oslo_db.sqlalchemy.engines [None req-23ba7858-025b-49dc-9fd9-2e8af91c9ce5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103066) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 09:48:01.117227 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG dbcounter [-] [103066] Writer thread running {{(pid=103066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 09:48:01.572146 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: WARNING keystonemiddleware.auth_token [None req-23ba7858-025b-49dc-9fd9-2e8af91c9ce5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 09:48:01.575953 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: WARNING keystonemiddleware.auth_token [None req-abb29518-2e8e-419f-bf4e-228401394252 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 09:48:01.579473 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: WARNING keystonemiddleware.auth_token [None req-23ba7858-025b-49dc-9fd9-2e8af91c9ce5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 09:48:01.583812 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: WARNING keystonemiddleware.auth_token [None req-abb29518-2e8e-419f-bf4e-228401394252 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 09:48:01.802616 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: WARNING keystonemiddleware.auth_token [None req-23ba7858-025b-49dc-9fd9-2e8af91c9ce5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 09:48:01.808547 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: WARNING keystonemiddleware.auth_token [None req-23ba7858-025b-49dc-9fd9-2e8af91c9ce5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 09:48:01.809850 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: WARNING keystonemiddleware.auth_token [None req-abb29518-2e8e-419f-bf4e-228401394252 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 09:48:01.813666 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e6566a09c0 pid: 103066 (default app) Jun 03 09:48:01.815730 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: WARNING keystonemiddleware.auth_token [None req-abb29518-2e8e-419f-bf4e-228401394252 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 09:48:01.815958 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi [None req-23ba7858-025b-49dc-9fd9-2e8af91c9ce5 None None] Calling method '>' {{(pid=103066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:48:01.817222 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: INFO nova.api.openstack.requestlog [None req-23ba7858-025b-49dc-9fd9-2e8af91c9ce5 None None] 10.222.0.45 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001775 Jun 03 09:48:01.817638 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: [pid: 103066|app: 0|req: 1/1] 10.222.0.45 () {50 vars in 788 bytes} [Fri Jun 3 09:48:01 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:48:01.820971 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e6566a09c0 pid: 103067 (default app) Jun 03 09:49:20.705116 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi [None req-23ba7858-025b-49dc-9fd9-2e8af91c9ce5 None None] Calling method '>' {{(pid=103066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:49:20.706685 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: INFO nova.api.openstack.requestlog [None req-23ba7858-025b-49dc-9fd9-2e8af91c9ce5 None None] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001985 Jun 03 09:49:20.707081 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: [pid: 103066|app: 0|req: 2/2] 10.222.0.45 () {54 vars in 930 bytes} [Fri Jun 3 09:49:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:49:20.719407 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG dbcounter [-] [103067] Writing DB stats nova_api:SELECT=3 {{(pid=103067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:49:20.720466 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG dbcounter [-] [103067] Writing DB stats nova_cell0:SELECT=3 {{(pid=103067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:49:20.721508 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG dbcounter [-] [103067] Writing DB stats nova_cell1:SELECT=3 {{(pid=103067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:49:20.722358 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG dbcounter [-] [103067] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:49:21.151807 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi [None req-104fdfc1-1a1a-4a17-a6dd-ebfa6d06af98 admin admin] Calling method '>' {{(pid=103067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:49:21.183757 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: INFO nova.api.openstack.requestlog [None req-104fdfc1-1a1a-4a17-a6dd-ebfa6d06af98 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.469601 Jun 03 09:49:21.184300 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: [pid: 103067|app: 0|req: 1/3] 10.222.0.45 () {60 vars in 1291 bytes} [Fri Jun 3 09:49:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:49:23.496230 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi [None req-23ba7858-025b-49dc-9fd9-2e8af91c9ce5 None None] Calling method '>' {{(pid=103066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:49:23.497228 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: INFO nova.api.openstack.requestlog [None req-23ba7858-025b-49dc-9fd9-2e8af91c9ce5 None None] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Jun 03 09:49:23.497938 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: [pid: 103066|app: 0|req: 3/4] 10.222.0.45 () {54 vars in 930 bytes} [Fri Jun 3 09:49:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:49:23.558867 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi [None req-abdb5c2e-dff7-44df-8c89-4801243042c2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 1, "name": "cirros256", "id": "c1", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:49:23.578233 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 09:49:23.578233 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: warnings.warn(msg) Jun 03 09:49:23.610465 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: INFO nova.api.openstack.requestlog [None req-abdb5c2e-dff7-44df-8c89-4801243042c2 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.106063 Jun 03 09:49:23.611324 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: [pid: 103067|app: 0|req: 2/5] 10.222.0.45 () {64 vars in 1282 bytes} [Fri Jun 3 09:49:23 2022] POST /compute/v2.1/flavors => generated 407 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 03 09:49:23.625107 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG dbcounter [-] [103066] Writing DB stats nova_api:SELECT=3 {{(pid=103066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:49:23.626387 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG dbcounter [-] [103066] Writing DB stats nova_cell0:SELECT=3 {{(pid=103066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:49:23.627508 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG dbcounter [-] [103066] Writing DB stats nova_cell1:SELECT=3 {{(pid=103066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:49:23.628678 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG dbcounter [-] [103066] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:49:23.831051 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi [None req-36e977a7-956a-4934-8aa2-e2d57782151e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:49:23.833482 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 09:49:23.833482 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: warnings.warn(msg) Jun 03 09:49:23.896581 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: INFO nova.api.openstack.requestlog [None req-36e977a7-956a-4934-8aa2-e2d57782151e admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.276586 Jun 03 09:49:23.906867 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: [pid: 103066|app: 0|req: 4/6] 10.222.0.45 () {64 vars in 1335 bytes} [Fri Jun 3 09:49:23 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:49:26.213581 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi [None req-abdb5c2e-dff7-44df-8c89-4801243042c2 admin admin] Calling method '>' {{(pid=103067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:49:26.214586 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: INFO nova.api.openstack.requestlog [None req-abdb5c2e-dff7-44df-8c89-4801243042c2 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Jun 03 09:49:26.215260 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: [pid: 103067|app: 0|req: 3/7] 10.222.0.45 () {54 vars in 930 bytes} [Fri Jun 3 09:49:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:49:26.322057 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi [None req-303515d4-c758-4757-856a-762924dfcc02 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 512, "disk": 5, "id": "d1", "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "swap": 0}} {{(pid=103066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:49:26.340148 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 09:49:26.340148 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: warnings.warn(msg) Jun 03 09:49:26.358271 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: INFO nova.api.openstack.requestlog [None req-303515d4-c758-4757-856a-762924dfcc02 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.137051 Jun 03 09:49:26.358829 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: [pid: 103066|app: 0|req: 5/8] 10.222.0.45 () {64 vars in 1282 bytes} [Fri Jun 3 09:49:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 09:49:26.370671 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi [None req-3d758678-522c-4177-b74f-3448fc1a2c15 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:49:26.372201 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 09:49:26.372201 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: warnings.warn(msg) Jun 03 09:49:26.406879 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: INFO nova.api.openstack.requestlog [None req-3d758678-522c-4177-b74f-3448fc1a2c15 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039832 Jun 03 09:49:26.407475 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: [pid: 103067|app: 0|req: 4/9] 10.222.0.45 () {64 vars in 1335 bytes} [Fri Jun 3 09:49:26 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:49:28.712273 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi [None req-303515d4-c758-4757-856a-762924dfcc02 admin admin] Calling method '>' {{(pid=103066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:49:28.713295 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: INFO nova.api.openstack.requestlog [None req-303515d4-c758-4757-856a-762924dfcc02 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jun 03 09:49:28.713985 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: [pid: 103066|app: 0|req: 6/10] 10.222.0.45 () {54 vars in 930 bytes} [Fri Jun 3 09:49:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:49:28.772825 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi [None req-d07dc6ea-b836-4cf5-822a-64d03312d312 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "rxtx_factor": 1.0, "ram": 1024, "id": "d2", "swap": 0, "disk": 10, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=103067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:49:28.793031 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: INFO nova.api.openstack.requestlog [None req-d07dc6ea-b836-4cf5-822a-64d03312d312 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073122 Jun 03 09:49:28.797876 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: [pid: 103067|app: 0|req: 5/11] 10.222.0.45 () {64 vars in 1282 bytes} [Fri Jun 3 09:49:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 09:49:28.806510 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi [None req-1ae9ebf5-5fed-43e6-9c2e-ff070259bb31 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:49:28.830550 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: INFO nova.api.openstack.requestlog [None req-1ae9ebf5-5fed-43e6-9c2e-ff070259bb31 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027696 Jun 03 09:49:28.834060 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: [pid: 103066|app: 0|req: 7/12] 10.222.0.45 () {64 vars in 1335 bytes} [Fri Jun 3 09:49:28 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:49:31.155958 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi [None req-d07dc6ea-b836-4cf5-822a-64d03312d312 admin admin] Calling method '>' {{(pid=103067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:49:31.157028 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: INFO nova.api.openstack.requestlog [None req-d07dc6ea-b836-4cf5-822a-64d03312d312 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Jun 03 09:49:31.157433 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: [pid: 103067|app: 0|req: 6/13] 10.222.0.45 () {54 vars in 930 bytes} [Fri Jun 3 09:49:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:49:31.228841 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi [None req-8583255f-e280-410d-9937-5fac244f6206 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "disk": 10, "vcpus": 2, "name": "ds2G", "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0}} {{(pid=103066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:49:31.248807 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: INFO nova.api.openstack.requestlog [None req-8583255f-e280-410d-9937-5fac244f6206 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.085266 Jun 03 09:49:31.249371 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: [pid: 103066|app: 0|req: 8/14] 10.222.0.45 () {64 vars in 1282 bytes} [Fri Jun 3 09:49:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 03 09:49:31.262187 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi [None req-41aae02d-1888-4a70-8213-6463172b1d8d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:49:31.287793 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: INFO nova.api.openstack.requestlog [None req-41aae02d-1888-4a70-8213-6463172b1d8d admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029553 Jun 03 09:49:31.288386 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: [pid: 103067|app: 0|req: 7/15] 10.222.0.45 () {64 vars in 1335 bytes} [Fri Jun 3 09:49:31 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:49:33.649925 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi [None req-8583255f-e280-410d-9937-5fac244f6206 admin admin] Calling method '>' {{(pid=103066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:49:33.651807 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: INFO nova.api.openstack.requestlog [None req-8583255f-e280-410d-9937-5fac244f6206 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002074 Jun 03 09:49:33.652281 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: [pid: 103066|app: 0|req: 9/16] 10.222.0.45 () {54 vars in 930 bytes} [Fri Jun 3 09:49:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:49:33.711304 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi [None req-97821a31-a082-4dba-a9e6-352c35a00938 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 4, "ram": 4096, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "disk": 20}} {{(pid=103067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:49:33.732494 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: INFO nova.api.openstack.requestlog [None req-97821a31-a082-4dba-a9e6-352c35a00938 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074311 Jun 03 09:49:33.733059 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: [pid: 103067|app: 0|req: 8/17] 10.222.0.45 () {64 vars in 1282 bytes} [Fri Jun 3 09:49:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 09:49:33.744984 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi [None req-92f529e1-5385-438a-a7e8-f1f935630a45 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:49:33.768449 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: INFO nova.api.openstack.requestlog [None req-92f529e1-5385-438a-a7e8-f1f935630a45 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026657 Jun 03 09:49:33.769343 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: [pid: 103066|app: 0|req: 10/18] 10.222.0.45 () {64 vars in 1335 bytes} [Fri Jun 3 09:49:33 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:49:36.046120 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi [None req-97821a31-a082-4dba-a9e6-352c35a00938 admin admin] Calling method '>' {{(pid=103067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:49:36.047133 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: INFO nova.api.openstack.requestlog [None req-97821a31-a082-4dba-a9e6-352c35a00938 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Jun 03 09:49:36.047536 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: [pid: 103067|app: 0|req: 9/19] 10.222.0.45 () {54 vars in 930 bytes} [Fri Jun 3 09:49:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:49:36.115791 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi [None req-47d8769f-ae17-4cbb-9381-a5c67113e8c8 admin admin] Calling method '>' {{(pid=103066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:49:36.143243 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: INFO nova.api.openstack.requestlog [None req-47d8769f-ae17-4cbb-9381-a5c67113e8c8 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.088601 Jun 03 09:49:36.143794 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: [pid: 103066|app: 0|req: 11/20] 10.222.0.45 () {60 vars in 1291 bytes} [Fri Jun 3 09:49:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:49:38.557077 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi [None req-97821a31-a082-4dba-a9e6-352c35a00938 admin admin] Calling method '>' {{(pid=103067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:49:38.558231 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: INFO nova.api.openstack.requestlog [None req-97821a31-a082-4dba-a9e6-352c35a00938 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001573 Jun 03 09:49:38.558775 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: [pid: 103067|app: 0|req: 10/21] 10.222.0.45 () {54 vars in 930 bytes} [Fri Jun 3 09:49:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:49:38.619284 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi [None req-992b35d0-8e91-4227-84f1-bb40851780d2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 1, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "id": "1", "rxtx_factor": 1.0, "name": "m1.tiny", "os-flavor-access:is_public": true}} {{(pid=103066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:49:38.639521 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: INFO nova.api.openstack.requestlog [None req-992b35d0-8e91-4227-84f1-bb40851780d2 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.073963 Jun 03 09:49:38.640548 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: [pid: 103066|app: 0|req: 12/22] 10.222.0.45 () {64 vars in 1282 bytes} [Fri Jun 3 09:49:38 2022] POST /compute/v2.1/flavors => generated 402 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 09:49:38.654007 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi [None req-e850ca5d-f110-45c7-9116-e7ae9c46fdba admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:49:38.679929 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: INFO nova.api.openstack.requestlog [None req-e850ca5d-f110-45c7-9116-e7ae9c46fdba admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029828 Jun 03 09:49:38.680554 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: [pid: 103067|app: 0|req: 11/23] 10.222.0.45 () {64 vars in 1332 bytes} [Fri Jun 3 09:49:38 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:49:41.086566 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi [None req-992b35d0-8e91-4227-84f1-bb40851780d2 admin admin] Calling method '>' {{(pid=103066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:49:41.087680 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: INFO nova.api.openstack.requestlog [None req-992b35d0-8e91-4227-84f1-bb40851780d2 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Jun 03 09:49:41.088101 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: [pid: 103066|app: 0|req: 13/24] 10.222.0.45 () {54 vars in 930 bytes} [Fri Jun 3 09:49:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:49:41.165216 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi [None req-082ed42a-5b2a-4704-9cb4-37477084cd2e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "2", "name": "m1.small", "os-flavor-access:is_public": true, "swap": 0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 2048}} {{(pid=103067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:49:41.183351 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: INFO nova.api.openstack.requestlog [None req-082ed42a-5b2a-4704-9cb4-37477084cd2e admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.089393 Jun 03 09:49:41.183973 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: [pid: 103067|app: 0|req: 12/25] 10.222.0.45 () {64 vars in 1282 bytes} [Fri Jun 3 09:49:41 2022] POST /compute/v2.1/flavors => generated 405 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 09:49:41.196819 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi [None req-9054a331-c07a-44a1-a8bf-7754c02af9eb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:49:41.220259 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: INFO nova.api.openstack.requestlog [None req-9054a331-c07a-44a1-a8bf-7754c02af9eb admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027208 Jun 03 09:49:41.221068 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: [pid: 103066|app: 0|req: 14/26] 10.222.0.45 () {64 vars in 1332 bytes} [Fri Jun 3 09:49:41 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:49:43.606663 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi [None req-082ed42a-5b2a-4704-9cb4-37477084cd2e admin admin] Calling method '>' {{(pid=103067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:49:43.607695 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: INFO nova.api.openstack.requestlog [None req-082ed42a-5b2a-4704-9cb4-37477084cd2e admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Jun 03 09:49:43.608108 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: [pid: 103067|app: 0|req: 13/27] 10.222.0.45 () {54 vars in 930 bytes} [Fri Jun 3 09:49:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:49:43.666383 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi [None req-8085e05f-4f8c-479f-9f69-134ed6221625 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "ram": 4096, "swap": 0, "name": "m1.medium", "id": "3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:49:43.684968 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: INFO nova.api.openstack.requestlog [None req-8085e05f-4f8c-479f-9f69-134ed6221625 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.070384 Jun 03 09:49:43.685533 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: [pid: 103066|app: 0|req: 15/28] 10.222.0.45 () {64 vars in 1282 bytes} [Fri Jun 3 09:49:43 2022] POST /compute/v2.1/flavors => generated 406 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 09:49:43.698092 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi [None req-56e802af-8385-4c59-9c88-28525c5ec284 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:49:43.724795 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: INFO nova.api.openstack.requestlog [None req-56e802af-8385-4c59-9c88-28525c5ec284 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030345 Jun 03 09:49:43.725424 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: [pid: 103067|app: 0|req: 14/29] 10.222.0.45 () {64 vars in 1332 bytes} [Fri Jun 3 09:49:43 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:49:45.997116 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi [None req-8085e05f-4f8c-479f-9f69-134ed6221625 admin admin] Calling method '>' {{(pid=103066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:49:45.998207 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: INFO nova.api.openstack.requestlog [None req-8085e05f-4f8c-479f-9f69-134ed6221625 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Jun 03 09:49:45.998619 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: [pid: 103066|app: 0|req: 16/30] 10.222.0.45 () {54 vars in 930 bytes} [Fri Jun 3 09:49:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:49:46.059036 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi [None req-0f7f2e11-7e29-4be0-9689-4c547fdd9759 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 8192, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "name": "m1.large", "vcpus": 4, "id": "4", "rxtx_factor": 1.0}} {{(pid=103067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:49:46.077219 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: INFO nova.api.openstack.requestlog [None req-0f7f2e11-7e29-4be0-9689-4c547fdd9759 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.070389 Jun 03 09:49:46.077784 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: [pid: 103067|app: 0|req: 15/31] 10.222.0.45 () {64 vars in 1282 bytes} [Fri Jun 3 09:49:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 09:49:46.089554 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi [None req-d853938e-9884-469b-8b1a-3dfcc4235325 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:49:46.112560 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: INFO nova.api.openstack.requestlog [None req-d853938e-9884-469b-8b1a-3dfcc4235325 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026598 Jun 03 09:49:46.113146 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: [pid: 103066|app: 0|req: 17/32] 10.222.0.45 () {64 vars in 1332 bytes} [Fri Jun 3 09:49:46 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:49:48.477669 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi [None req-0f7f2e11-7e29-4be0-9689-4c547fdd9759 admin admin] Calling method '>' {{(pid=103067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:49:48.478864 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: INFO nova.api.openstack.requestlog [None req-0f7f2e11-7e29-4be0-9689-4c547fdd9759 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001601 Jun 03 09:49:48.479257 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: [pid: 103067|app: 0|req: 16/33] 10.222.0.45 () {54 vars in 930 bytes} [Fri Jun 3 09:49:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:49:48.539758 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi [None req-5de46f25-c62b-451b-aa72-56da9a56b799 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "ram": 16384, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "id": "5", "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge"}} {{(pid=103066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:49:48.559190 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: INFO nova.api.openstack.requestlog [None req-5de46f25-c62b-451b-aa72-56da9a56b799 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.073261 Jun 03 09:49:48.559741 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: [pid: 103066|app: 0|req: 18/34] 10.222.0.45 () {64 vars in 1282 bytes} [Fri Jun 3 09:49:48 2022] POST /compute/v2.1/flavors => generated 408 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 09:49:48.571534 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi [None req-41db5f0c-0942-453e-8ef3-3c3e2f838445 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:49:48.594353 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: INFO nova.api.openstack.requestlog [None req-41db5f0c-0942-453e-8ef3-3c3e2f838445 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026456 Jun 03 09:49:48.595683 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: [pid: 103067|app: 0|req: 17/35] 10.222.0.45 () {64 vars in 1332 bytes} [Fri Jun 3 09:49:48 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:50:12.741347 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi [None req-5de46f25-c62b-451b-aa72-56da9a56b799 admin admin] Calling method '>' {{(pid=103066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:50:12.742370 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: INFO nova.api.openstack.requestlog [None req-5de46f25-c62b-451b-aa72-56da9a56b799 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Jun 03 09:50:12.742792 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: [pid: 103066|app: 0|req: 19/36] 10.222.0.45 () {54 vars in 930 bytes} [Fri Jun 3 09:50:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:50:12.753393 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG dbcounter [-] [103067] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:50:12.801386 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi [None req-5e546668-902f-4021-a861-df3b426eb2cd admin admin] Calling method '>' {{(pid=103067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:50:12.817946 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: INFO nova.api.openstack.requestlog [None req-5e546668-902f-4021-a861-df3b426eb2cd admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069153 Jun 03 09:50:12.818485 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: [pid: 103067|app: 0|req: 18/37] 10.222.0.45 () {60 vars in 1291 bytes} [Fri Jun 3 09:50:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:50:13.813284 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi [None req-5de46f25-c62b-451b-aa72-56da9a56b799 admin admin] Calling method '>' {{(pid=103066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:50:13.814342 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: INFO nova.api.openstack.requestlog [None req-5de46f25-c62b-451b-aa72-56da9a56b799 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Jun 03 09:50:13.814750 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: [pid: 103066|app: 0|req: 20/38] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Jun 3 09:50:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:50:14.005971 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi [None req-6af15be0-3b4f-47bc-af49-0615d9595b2e admin admin] Calling method '>' {{(pid=103067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:50:14.011563 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: INFO nova.api.openstack.wsgi [None req-6af15be0-3b4f-47bc-af49-0615d9595b2e admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 03 09:50:14.014931 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi [None req-6af15be0-3b4f-47bc-af49-0615d9595b2e admin admin] Request method failure captured: Jun 03 09:50:14.014931 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 03 09:50:14.014931 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: Accept: application/json Jun 03 09:50:14.014931 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: Accept-Encoding: gzip, deflate Jun 03 09:50:14.014931 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: Connection: keep-alive Jun 03 09:50:14.014931 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: Content-Length: 0 Jun 03 09:50:14.014931 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: Host: 10.222.0.45 Jun 03 09:50:14.014931 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: Openstack-Api-Version: compute 2.90 Jun 03 09:50:14.014931 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: Openstack-System-Scope: None Jun 03 09:50:14.014931 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: User-Agent: python-novaclient Jun 03 09:50:14.014931 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-Auth-Token: gAAAAABimdlVSPEjqL6TbArv11ghICqClhKo5-8tcjHAImBviGktdTrbRrjYryDV9QC6CvWTNLId3pv_nMS6evcDtf4yn7ZnpksfccKAGfBJgbOpAKOr33TJflUC4Y-b9P_oyrKxMIRg56ZNyiGxm5OnC2BuLJthrgOtrKDUJy76SpwsbXpGGPI Jun 03 09:50:14.014931 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-Domain-Id: None Jun 03 09:50:14.014931 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-Domain-Name: None Jun 03 09:50:14.014931 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-Identity-Status: Confirmed Jun 03 09:50:14.014931 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-Is-Admin-Project: True Jun 03 09:50:14.014931 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-Openstack-Nova-Api-Version: 2.90 Jun 03 09:50:14.014931 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-Project-Domain-Id: default Jun 03 09:50:14.014931 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-Project-Domain-Name: Default Jun 03 09:50:14.014931 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-Project-Id: 2a9104f36ddb422fa7bc883d1d00818c Jun 03 09:50:14.014931 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-Project-Name: admin Jun 03 09:50:14.014931 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-Role: member,reader,admin Jun 03 09:50:14.014931 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-Roles: member,reader,admin Jun 03 09:50:14.016583 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2a9104f36ddb422fa7bc883d1d00818c", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2a9104f36ddb422fa7bc883d1d00818c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2a9104f36ddb422fa7bc883d1d00818c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2a9104f36ddb422fa7bc883d1d00818c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 09:50:14.016583 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-Tenant: admin Jun 03 09:50:14.016583 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-Tenant-Id: 2a9104f36ddb422fa7bc883d1d00818c Jun 03 09:50:14.016583 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-Tenant-Name: admin Jun 03 09:50:14.016583 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-User: admin Jun 03 09:50:14.016583 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-User-Domain-Id: default Jun 03 09:50:14.016583 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-User-Domain-Name: Default Jun 03 09:50:14.016583 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-User-Id: 8ac41a57acdf4a3aa3f15e8d08769048 Jun 03 09:50:14.016583 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-User-Name: admin Jun 03 09:50:14.016583 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: method: > Jun 03 09:50:14.016583 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: exception: Flavor 42 could not be found. Jun 03 09:50:14.016583 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: action_args: {'id': '42'} Jun 03 09:50:14.016583 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: {{(pid=103067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:50:14.016583 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:50:14.017529 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 03 09:50:14.017529 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 03 09:50:14.017529 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 03 09:50:14.017529 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 03 09:50:14.017529 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 03 09:50:14.017529 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 03 09:50:14.017529 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 03 09:50:14.017529 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 03 09:50:14.017529 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 03 09:50:14.017529 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:50:14.017529 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 03 09:50:14.017529 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 03 09:50:14.017529 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 03 09:50:14.017529 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi Jun 03 09:50:14.017529 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:50:14.017529 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi Jun 03 09:50:14.017529 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:50:14.017529 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:50:14.017529 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:50:14.018729 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:50:14.018729 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:50:14.018729 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:50:14.018729 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:50:14.018729 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 03 09:50:14.018729 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:50:14.018729 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 03 09:50:14.018729 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi Jun 03 09:50:14.018729 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:50:14.018729 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi Jun 03 09:50:14.018729 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:50:14.018729 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:50:14.018729 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:50:14.018729 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:50:14.018729 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:50:14.018729 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 03 09:50:14.018729 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi Jun 03 09:50:14.018729 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi [None req-6af15be0-3b4f-47bc-af49-0615d9595b2e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:50:14.019896 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: INFO nova.api.openstack.requestlog [None req-6af15be0-3b4f-47bc-af49-0615d9595b2e admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061428 Jun 03 09:50:14.019896 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: [pid: 103067|app: 0|req: 19/39] 10.222.0.45 () {60 vars in 1190 bytes} [Fri Jun 3 09:50:13 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 03 09:50:14.026119 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi [None req-19d074f9-0731-4bf5-8981-2cca3e361ee5 admin admin] Calling method '>' {{(pid=103066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:50:14.029321 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG dbcounter [-] [103066] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:50:14.049616 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: INFO nova.api.openstack.requestlog [None req-19d074f9-0731-4bf5-8981-2cca3e361ee5 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027054 Jun 03 09:50:14.050218 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: [pid: 103066|app: 0|req: 21/40] 10.222.0.45 () {60 vars in 1210 bytes} [Fri Jun 3 09:50:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:50:14.061069 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi [None req-d8061fd3-827d-45a5-b7c6-34b02546d072 admin admin] Calling method '>' {{(pid=103067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:50:14.082126 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: INFO nova.api.openstack.requestlog [None req-d8061fd3-827d-45a5-b7c6-34b02546d072 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024726 Jun 03 09:50:14.082714 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: [pid: 103067|app: 0|req: 20/41] 10.222.0.45 () {60 vars in 1210 bytes} [Fri Jun 3 09:50:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:50:14.092690 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi [None req-6b625b47-cf93-4b43-9350-1a7643020f96 admin admin] Calling method '>' {{(pid=103066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:50:14.099395 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: INFO nova.api.openstack.wsgi [None req-6b625b47-cf93-4b43-9350-1a7643020f96 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 03 09:50:14.102600 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi [None req-6b625b47-cf93-4b43-9350-1a7643020f96 admin admin] Request method failure captured: Jun 03 09:50:14.102600 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 03 09:50:14.102600 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: Accept: application/json Jun 03 09:50:14.102600 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: Accept-Encoding: gzip, deflate Jun 03 09:50:14.102600 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: Connection: keep-alive Jun 03 09:50:14.102600 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: Content-Length: 0 Jun 03 09:50:14.102600 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: Host: 10.222.0.45 Jun 03 09:50:14.102600 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: Openstack-Api-Version: compute 2.90 Jun 03 09:50:14.102600 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: Openstack-System-Scope: None Jun 03 09:50:14.102600 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: User-Agent: python-novaclient Jun 03 09:50:14.102600 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-Auth-Token: gAAAAABimdlVSPEjqL6TbArv11ghICqClhKo5-8tcjHAImBviGktdTrbRrjYryDV9QC6CvWTNLId3pv_nMS6evcDtf4yn7ZnpksfccKAGfBJgbOpAKOr33TJflUC4Y-b9P_oyrKxMIRg56ZNyiGxm5OnC2BuLJthrgOtrKDUJy76SpwsbXpGGPI Jun 03 09:50:14.102600 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-Domain-Id: None Jun 03 09:50:14.102600 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-Domain-Name: None Jun 03 09:50:14.102600 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-Identity-Status: Confirmed Jun 03 09:50:14.102600 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-Is-Admin-Project: True Jun 03 09:50:14.102600 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-Openstack-Nova-Api-Version: 2.90 Jun 03 09:50:14.102600 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-Project-Domain-Id: default Jun 03 09:50:14.102600 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-Project-Domain-Name: Default Jun 03 09:50:14.102600 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-Project-Id: 2a9104f36ddb422fa7bc883d1d00818c Jun 03 09:50:14.102600 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-Project-Name: admin Jun 03 09:50:14.102600 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-Role: member,reader,admin Jun 03 09:50:14.102600 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-Roles: member,reader,admin Jun 03 09:50:14.104113 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2a9104f36ddb422fa7bc883d1d00818c", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2a9104f36ddb422fa7bc883d1d00818c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2a9104f36ddb422fa7bc883d1d00818c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2a9104f36ddb422fa7bc883d1d00818c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 09:50:14.104113 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-Tenant: admin Jun 03 09:50:14.104113 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-Tenant-Id: 2a9104f36ddb422fa7bc883d1d00818c Jun 03 09:50:14.104113 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-Tenant-Name: admin Jun 03 09:50:14.104113 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-User: admin Jun 03 09:50:14.104113 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-User-Domain-Id: default Jun 03 09:50:14.104113 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-User-Domain-Name: Default Jun 03 09:50:14.104113 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-User-Id: 8ac41a57acdf4a3aa3f15e8d08769048 Jun 03 09:50:14.104113 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-User-Name: admin Jun 03 09:50:14.104113 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: method: > Jun 03 09:50:14.104113 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: exception: Flavor 42 could not be found. Jun 03 09:50:14.104113 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: action_args: {'id': '42'} Jun 03 09:50:14.104113 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: {{(pid=103066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:50:14.104113 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:50:14.105104 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 03 09:50:14.105104 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 03 09:50:14.105104 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 03 09:50:14.105104 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 03 09:50:14.105104 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 03 09:50:14.105104 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 03 09:50:14.105104 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 03 09:50:14.105104 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 03 09:50:14.105104 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 03 09:50:14.105104 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:50:14.105104 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 03 09:50:14.105104 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 03 09:50:14.105104 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 03 09:50:14.105104 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi Jun 03 09:50:14.105104 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:50:14.105104 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi Jun 03 09:50:14.105104 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:50:14.105104 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:50:14.105104 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:50:14.106575 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:50:14.106575 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:50:14.106575 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:50:14.106575 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:50:14.106575 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 03 09:50:14.106575 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:50:14.106575 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 03 09:50:14.106575 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi Jun 03 09:50:14.106575 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:50:14.106575 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi Jun 03 09:50:14.106575 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:50:14.106575 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:50:14.106575 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:50:14.106575 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:50:14.106575 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:50:14.106575 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 03 09:50:14.106575 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi Jun 03 09:50:14.106575 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi [None req-6b625b47-cf93-4b43-9350-1a7643020f96 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:50:14.107830 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: INFO nova.api.openstack.requestlog [None req-6b625b47-cf93-4b43-9350-1a7643020f96 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015460 Jun 03 09:50:14.107830 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: [pid: 103066|app: 0|req: 22/42] 10.222.0.45 () {60 vars in 1190 bytes} [Fri Jun 3 09:50:14 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 03 09:50:14.970249 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi [None req-d8061fd3-827d-45a5-b7c6-34b02546d072 admin admin] Calling method '>' {{(pid=103067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:50:14.971295 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: INFO nova.api.openstack.requestlog [None req-d8061fd3-827d-45a5-b7c6-34b02546d072 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Jun 03 09:50:14.971695 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: [pid: 103067|app: 0|req: 21/43] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Jun 3 09:50:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:50:15.159132 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi [None req-331807bf-3b1d-474d-bf18-b723774b18aa admin admin] Calling method '>' {{(pid=103066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:50:15.164702 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: INFO nova.api.openstack.wsgi [None req-331807bf-3b1d-474d-bf18-b723774b18aa admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 03 09:50:15.166265 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi [None req-331807bf-3b1d-474d-bf18-b723774b18aa admin admin] Request method failure captured: Jun 03 09:50:15.166265 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 03 09:50:15.166265 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: Accept: application/json Jun 03 09:50:15.166265 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: Accept-Encoding: gzip, deflate Jun 03 09:50:15.166265 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: Connection: keep-alive Jun 03 09:50:15.166265 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: Content-Length: 0 Jun 03 09:50:15.166265 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: Host: 10.222.0.45 Jun 03 09:50:15.166265 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: Openstack-Api-Version: compute 2.90 Jun 03 09:50:15.166265 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: Openstack-System-Scope: None Jun 03 09:50:15.166265 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: User-Agent: python-novaclient Jun 03 09:50:15.166265 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-Auth-Token: gAAAAABimdlWV5z-lT25sJmPBjYw7lRPGxFyL35Ij3gejQKbUeD-ws0KHCXzg7f_F-dgn05FQ8nPyO_imcYh5_FjqrC89ieZMWNkbHZGehotPf-fN0Lx8JQYm-UsmvpDXvlrDXpQOX9HctLpxkbZ5dxFuwAm9NTpkBrLDsLrnznRraEBP0nNBxU Jun 03 09:50:15.166265 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-Domain-Id: None Jun 03 09:50:15.166265 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-Domain-Name: None Jun 03 09:50:15.166265 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-Identity-Status: Confirmed Jun 03 09:50:15.166265 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-Is-Admin-Project: True Jun 03 09:50:15.166265 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-Openstack-Nova-Api-Version: 2.90 Jun 03 09:50:15.166265 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-Project-Domain-Id: default Jun 03 09:50:15.166265 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-Project-Domain-Name: Default Jun 03 09:50:15.166265 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-Project-Id: 2a9104f36ddb422fa7bc883d1d00818c Jun 03 09:50:15.166265 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-Project-Name: admin Jun 03 09:50:15.166265 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-Role: member,reader,admin Jun 03 09:50:15.166265 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-Roles: member,reader,admin Jun 03 09:50:15.167811 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2a9104f36ddb422fa7bc883d1d00818c", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2a9104f36ddb422fa7bc883d1d00818c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2a9104f36ddb422fa7bc883d1d00818c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2a9104f36ddb422fa7bc883d1d00818c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 09:50:15.167811 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-Tenant: admin Jun 03 09:50:15.167811 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-Tenant-Id: 2a9104f36ddb422fa7bc883d1d00818c Jun 03 09:50:15.167811 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-Tenant-Name: admin Jun 03 09:50:15.167811 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-User: admin Jun 03 09:50:15.167811 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-User-Domain-Id: default Jun 03 09:50:15.167811 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-User-Domain-Name: Default Jun 03 09:50:15.167811 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-User-Id: 8ac41a57acdf4a3aa3f15e8d08769048 Jun 03 09:50:15.167811 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-User-Name: admin Jun 03 09:50:15.167811 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: method: > Jun 03 09:50:15.167811 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: exception: Flavor 84 could not be found. Jun 03 09:50:15.167811 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: action_args: {'id': '84'} Jun 03 09:50:15.167811 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: {{(pid=103066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:50:15.167811 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:50:15.168653 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 03 09:50:15.168653 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 03 09:50:15.168653 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 03 09:50:15.168653 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 03 09:50:15.168653 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 03 09:50:15.168653 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 03 09:50:15.168653 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 03 09:50:15.168653 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 03 09:50:15.168653 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 03 09:50:15.168653 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:50:15.168653 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 03 09:50:15.168653 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 03 09:50:15.168653 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 03 09:50:15.168653 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi Jun 03 09:50:15.168653 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:50:15.168653 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi Jun 03 09:50:15.168653 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:50:15.168653 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:50:15.168653 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:50:15.169687 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:50:15.169687 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:50:15.169687 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:50:15.169687 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:50:15.169687 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 03 09:50:15.169687 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:50:15.169687 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 03 09:50:15.169687 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi Jun 03 09:50:15.169687 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:50:15.169687 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi Jun 03 09:50:15.169687 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:50:15.169687 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:50:15.169687 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:50:15.169687 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:50:15.169687 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:50:15.169687 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 03 09:50:15.169687 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi Jun 03 09:50:15.169687 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi [None req-331807bf-3b1d-474d-bf18-b723774b18aa admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:50:15.170749 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: INFO nova.api.openstack.requestlog [None req-331807bf-3b1d-474d-bf18-b723774b18aa admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061180 Jun 03 09:50:15.170749 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: [pid: 103066|app: 0|req: 23/44] 10.222.0.45 () {60 vars in 1190 bytes} [Fri Jun 3 09:50:15 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 03 09:50:15.177979 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi [None req-c2b99104-b5af-40c3-b2e5-6688853f46e9 admin admin] Calling method '>' {{(pid=103067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:50:15.192300 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: INFO nova.api.openstack.requestlog [None req-c2b99104-b5af-40c3-b2e5-6688853f46e9 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018629 Jun 03 09:50:15.192828 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: [pid: 103067|app: 0|req: 22/45] 10.222.0.45 () {60 vars in 1210 bytes} [Fri Jun 3 09:50:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:50:15.202041 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi [None req-c93bf6c1-62f6-4b22-8b86-91fdd1853a20 admin admin] Calling method '>' {{(pid=103066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:50:15.215510 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: INFO nova.api.openstack.requestlog [None req-c93bf6c1-62f6-4b22-8b86-91fdd1853a20 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016992 Jun 03 09:50:15.216029 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: [pid: 103066|app: 0|req: 24/46] 10.222.0.45 () {60 vars in 1210 bytes} [Fri Jun 3 09:50:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:50:15.225083 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi [None req-2b57e6ab-166d-46e2-b009-1ea5a990b4c0 admin admin] Calling method '>' {{(pid=103067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:50:15.230323 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: INFO nova.api.openstack.wsgi [None req-2b57e6ab-166d-46e2-b009-1ea5a990b4c0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 03 09:50:15.231806 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi [None req-2b57e6ab-166d-46e2-b009-1ea5a990b4c0 admin admin] Request method failure captured: Jun 03 09:50:15.231806 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 03 09:50:15.231806 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: Accept: application/json Jun 03 09:50:15.231806 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: Accept-Encoding: gzip, deflate Jun 03 09:50:15.231806 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: Connection: keep-alive Jun 03 09:50:15.231806 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: Content-Length: 0 Jun 03 09:50:15.231806 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: Host: 10.222.0.45 Jun 03 09:50:15.231806 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: Openstack-Api-Version: compute 2.90 Jun 03 09:50:15.231806 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: Openstack-System-Scope: None Jun 03 09:50:15.231806 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: User-Agent: python-novaclient Jun 03 09:50:15.231806 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-Auth-Token: gAAAAABimdlWV5z-lT25sJmPBjYw7lRPGxFyL35Ij3gejQKbUeD-ws0KHCXzg7f_F-dgn05FQ8nPyO_imcYh5_FjqrC89ieZMWNkbHZGehotPf-fN0Lx8JQYm-UsmvpDXvlrDXpQOX9HctLpxkbZ5dxFuwAm9NTpkBrLDsLrnznRraEBP0nNBxU Jun 03 09:50:15.231806 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-Domain-Id: None Jun 03 09:50:15.231806 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-Domain-Name: None Jun 03 09:50:15.231806 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-Identity-Status: Confirmed Jun 03 09:50:15.231806 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-Is-Admin-Project: True Jun 03 09:50:15.231806 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-Openstack-Nova-Api-Version: 2.90 Jun 03 09:50:15.231806 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-Project-Domain-Id: default Jun 03 09:50:15.231806 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-Project-Domain-Name: Default Jun 03 09:50:15.231806 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-Project-Id: 2a9104f36ddb422fa7bc883d1d00818c Jun 03 09:50:15.231806 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-Project-Name: admin Jun 03 09:50:15.231806 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-Role: member,reader,admin Jun 03 09:50:15.231806 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-Roles: member,reader,admin Jun 03 09:50:15.233327 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2a9104f36ddb422fa7bc883d1d00818c", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2a9104f36ddb422fa7bc883d1d00818c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2a9104f36ddb422fa7bc883d1d00818c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2a9104f36ddb422fa7bc883d1d00818c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 09:50:15.233327 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-Tenant: admin Jun 03 09:50:15.233327 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-Tenant-Id: 2a9104f36ddb422fa7bc883d1d00818c Jun 03 09:50:15.233327 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-Tenant-Name: admin Jun 03 09:50:15.233327 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-User: admin Jun 03 09:50:15.233327 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-User-Domain-Id: default Jun 03 09:50:15.233327 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-User-Domain-Name: Default Jun 03 09:50:15.233327 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-User-Id: 8ac41a57acdf4a3aa3f15e8d08769048 Jun 03 09:50:15.233327 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-User-Name: admin Jun 03 09:50:15.233327 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: method: > Jun 03 09:50:15.233327 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: exception: Flavor 84 could not be found. Jun 03 09:50:15.233327 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: action_args: {'id': '84'} Jun 03 09:50:15.233327 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: {{(pid=103067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:50:15.233327 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:50:15.234242 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 03 09:50:15.234242 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 03 09:50:15.234242 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 03 09:50:15.234242 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 03 09:50:15.234242 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 03 09:50:15.234242 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 03 09:50:15.234242 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 03 09:50:15.234242 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 03 09:50:15.234242 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 03 09:50:15.234242 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:50:15.234242 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 03 09:50:15.234242 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 03 09:50:15.234242 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 03 09:50:15.234242 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi Jun 03 09:50:15.234242 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:50:15.234242 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi Jun 03 09:50:15.234242 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:50:15.234242 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:50:15.234242 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:50:15.235544 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:50:15.235544 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:50:15.235544 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:50:15.235544 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:50:15.235544 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 03 09:50:15.235544 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:50:15.235544 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 03 09:50:15.235544 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi Jun 03 09:50:15.235544 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:50:15.235544 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi Jun 03 09:50:15.235544 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:50:15.235544 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:50:15.235544 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:50:15.235544 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:50:15.235544 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:50:15.235544 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 03 09:50:15.235544 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi Jun 03 09:50:15.235544 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi [None req-2b57e6ab-166d-46e2-b009-1ea5a990b4c0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:50:15.237469 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: INFO nova.api.openstack.requestlog [None req-2b57e6ab-166d-46e2-b009-1ea5a990b4c0 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011573 Jun 03 09:50:15.237469 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: [pid: 103067|app: 0|req: 23/47] 10.222.0.45 () {60 vars in 1190 bytes} [Fri Jun 3 09:50:15 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 03 09:50:16.114254 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi [None req-c93bf6c1-62f6-4b22-8b86-91fdd1853a20 admin admin] Calling method '>' {{(pid=103066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:50:16.115273 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: INFO nova.api.openstack.requestlog [None req-c93bf6c1-62f6-4b22-8b86-91fdd1853a20 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Jun 03 09:50:16.115678 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: [pid: 103066|app: 0|req: 25/48] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Jun 3 09:50:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:50:16.301011 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi [None req-71194cde-77a2-4566-9d6d-394325fc93c8 admin admin] Calling method '>' {{(pid=103067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:50:16.306787 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: INFO nova.api.openstack.wsgi [None req-71194cde-77a2-4566-9d6d-394325fc93c8 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 03 09:50:16.308277 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi [None req-71194cde-77a2-4566-9d6d-394325fc93c8 admin admin] Request method failure captured: Jun 03 09:50:16.308277 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 03 09:50:16.308277 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: Accept: application/json Jun 03 09:50:16.308277 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: Accept-Encoding: gzip, deflate Jun 03 09:50:16.308277 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: Connection: keep-alive Jun 03 09:50:16.308277 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: Content-Length: 0 Jun 03 09:50:16.308277 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: Host: 10.222.0.45 Jun 03 09:50:16.308277 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: Openstack-Api-Version: compute 2.90 Jun 03 09:50:16.308277 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: Openstack-System-Scope: None Jun 03 09:50:16.308277 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: User-Agent: python-novaclient Jun 03 09:50:16.308277 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-Auth-Token: gAAAAABimdlYef8cii1KfBCp5-3AzQjnAGNevvw27HNv46rLC5l6vtErsILGyIk-Hm0gyDhdM-coyGIMfW9hxLQ4_m0vXRdg-NRPFejEfqQX8hB8eXVChGqjNPzgiaEyOXh1zfhVRzd4KigmScPd-EKd1mXtUoiNoFZaMBeOTjNEeMBXdb5qs8Y Jun 03 09:50:16.308277 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-Domain-Id: None Jun 03 09:50:16.308277 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-Domain-Name: None Jun 03 09:50:16.308277 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-Identity-Status: Confirmed Jun 03 09:50:16.308277 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-Is-Admin-Project: True Jun 03 09:50:16.308277 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-Openstack-Nova-Api-Version: 2.90 Jun 03 09:50:16.308277 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-Project-Domain-Id: default Jun 03 09:50:16.308277 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-Project-Domain-Name: Default Jun 03 09:50:16.308277 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-Project-Id: 2a9104f36ddb422fa7bc883d1d00818c Jun 03 09:50:16.308277 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-Project-Name: admin Jun 03 09:50:16.308277 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-Role: member,reader,admin Jun 03 09:50:16.308277 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-Roles: member,reader,admin Jun 03 09:50:16.309811 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2a9104f36ddb422fa7bc883d1d00818c", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2a9104f36ddb422fa7bc883d1d00818c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2a9104f36ddb422fa7bc883d1d00818c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2a9104f36ddb422fa7bc883d1d00818c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 09:50:16.309811 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-Tenant: admin Jun 03 09:50:16.309811 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-Tenant-Id: 2a9104f36ddb422fa7bc883d1d00818c Jun 03 09:50:16.309811 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-Tenant-Name: admin Jun 03 09:50:16.309811 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-User: admin Jun 03 09:50:16.309811 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-User-Domain-Id: default Jun 03 09:50:16.309811 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-User-Domain-Name: Default Jun 03 09:50:16.309811 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-User-Id: 8ac41a57acdf4a3aa3f15e8d08769048 Jun 03 09:50:16.309811 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: X-User-Name: admin Jun 03 09:50:16.309811 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: method: > Jun 03 09:50:16.309811 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: exception: Flavor 451 could not be found. Jun 03 09:50:16.309811 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: action_args: {'id': '451'} Jun 03 09:50:16.309811 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: {{(pid=103067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:50:16.309811 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:50:16.310718 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 03 09:50:16.310718 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 03 09:50:16.310718 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 03 09:50:16.310718 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 03 09:50:16.310718 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 03 09:50:16.310718 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 03 09:50:16.310718 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 03 09:50:16.310718 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 03 09:50:16.310718 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 03 09:50:16.310718 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:50:16.310718 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 03 09:50:16.310718 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 03 09:50:16.310718 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 03 09:50:16.310718 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi Jun 03 09:50:16.310718 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:50:16.310718 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi Jun 03 09:50:16.310718 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:50:16.310718 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:50:16.310718 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:50:16.311752 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:50:16.311752 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:50:16.311752 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:50:16.311752 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:50:16.311752 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 03 09:50:16.311752 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:50:16.311752 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 03 09:50:16.311752 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi Jun 03 09:50:16.311752 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:50:16.311752 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi Jun 03 09:50:16.311752 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:50:16.311752 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:50:16.311752 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:50:16.311752 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:50:16.311752 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:50:16.311752 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 03 09:50:16.311752 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: ERROR nova.api.openstack.wsgi Jun 03 09:50:16.311752 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi [None req-71194cde-77a2-4566-9d6d-394325fc93c8 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103067) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:50:16.312831 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: INFO nova.api.openstack.requestlog [None req-71194cde-77a2-4566-9d6d-394325fc93c8 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059172 Jun 03 09:50:16.312831 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: [pid: 103067|app: 0|req: 24/49] 10.222.0.45 () {60 vars in 1193 bytes} [Fri Jun 3 09:50:16 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 03 09:50:16.319917 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi [None req-44adb176-dc0e-4d31-bd65-8f3e9e2dcfae admin admin] Calling method '>' {{(pid=103066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:50:16.333464 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: INFO nova.api.openstack.requestlog [None req-44adb176-dc0e-4d31-bd65-8f3e9e2dcfae admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017577 Jun 03 09:50:16.333955 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: [pid: 103066|app: 0|req: 26/50] 10.222.0.45 () {60 vars in 1210 bytes} [Fri Jun 3 09:50:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:50:16.343264 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi [None req-8c518dd5-38ae-4ff3-bcd2-27ba06ab1034 admin admin] Calling method '>' {{(pid=103067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:50:16.357114 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: INFO nova.api.openstack.requestlog [None req-8c518dd5-38ae-4ff3-bcd2-27ba06ab1034 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017758 Jun 03 09:50:16.357631 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: [pid: 103067|app: 0|req: 25/51] 10.222.0.45 () {60 vars in 1210 bytes} [Fri Jun 3 09:50:16 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:50:16.367050 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi [None req-a9bb7a67-5d7a-43d7-b6ce-789dcc147e8d admin admin] Calling method '>' {{(pid=103066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:50:16.372311 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: INFO nova.api.openstack.wsgi [None req-a9bb7a67-5d7a-43d7-b6ce-789dcc147e8d admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 03 09:50:16.373838 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi [None req-a9bb7a67-5d7a-43d7-b6ce-789dcc147e8d admin admin] Request method failure captured: Jun 03 09:50:16.373838 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 03 09:50:16.373838 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: Accept: application/json Jun 03 09:50:16.373838 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: Accept-Encoding: gzip, deflate Jun 03 09:50:16.373838 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: Connection: keep-alive Jun 03 09:50:16.373838 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: Content-Length: 0 Jun 03 09:50:16.373838 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: Host: 10.222.0.45 Jun 03 09:50:16.373838 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: Openstack-Api-Version: compute 2.90 Jun 03 09:50:16.373838 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: Openstack-System-Scope: None Jun 03 09:50:16.373838 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: User-Agent: python-novaclient Jun 03 09:50:16.373838 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-Auth-Token: gAAAAABimdlYef8cii1KfBCp5-3AzQjnAGNevvw27HNv46rLC5l6vtErsILGyIk-Hm0gyDhdM-coyGIMfW9hxLQ4_m0vXRdg-NRPFejEfqQX8hB8eXVChGqjNPzgiaEyOXh1zfhVRzd4KigmScPd-EKd1mXtUoiNoFZaMBeOTjNEeMBXdb5qs8Y Jun 03 09:50:16.373838 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-Domain-Id: None Jun 03 09:50:16.373838 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-Domain-Name: None Jun 03 09:50:16.373838 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-Identity-Status: Confirmed Jun 03 09:50:16.373838 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-Is-Admin-Project: True Jun 03 09:50:16.373838 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-Openstack-Nova-Api-Version: 2.90 Jun 03 09:50:16.373838 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-Project-Domain-Id: default Jun 03 09:50:16.373838 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-Project-Domain-Name: Default Jun 03 09:50:16.373838 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-Project-Id: 2a9104f36ddb422fa7bc883d1d00818c Jun 03 09:50:16.373838 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-Project-Name: admin Jun 03 09:50:16.373838 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-Role: member,reader,admin Jun 03 09:50:16.373838 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-Roles: member,reader,admin Jun 03 09:50:16.375446 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_2a9104f36ddb422fa7bc883d1d00818c", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/2a9104f36ddb422fa7bc883d1d00818c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2a9104f36ddb422fa7bc883d1d00818c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/2a9104f36ddb422fa7bc883d1d00818c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 09:50:16.375446 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-Tenant: admin Jun 03 09:50:16.375446 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-Tenant-Id: 2a9104f36ddb422fa7bc883d1d00818c Jun 03 09:50:16.375446 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-Tenant-Name: admin Jun 03 09:50:16.375446 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-User: admin Jun 03 09:50:16.375446 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-User-Domain-Id: default Jun 03 09:50:16.375446 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-User-Domain-Name: Default Jun 03 09:50:16.375446 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-User-Id: 8ac41a57acdf4a3aa3f15e8d08769048 Jun 03 09:50:16.375446 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: X-User-Name: admin Jun 03 09:50:16.375446 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: method: > Jun 03 09:50:16.375446 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: exception: Flavor 451 could not be found. Jun 03 09:50:16.375446 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: action_args: {'id': '451'} Jun 03 09:50:16.375446 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: {{(pid=103066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:50:16.375446 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:50:16.381470 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 03 09:50:16.381470 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 03 09:50:16.381470 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 03 09:50:16.381470 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 03 09:50:16.381470 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 03 09:50:16.381470 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 03 09:50:16.381470 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 03 09:50:16.381470 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 03 09:50:16.381470 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 03 09:50:16.381470 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:50:16.381470 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 03 09:50:16.381470 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 03 09:50:16.381470 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 03 09:50:16.381470 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi Jun 03 09:50:16.381470 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:50:16.381470 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi Jun 03 09:50:16.381470 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:50:16.381470 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:50:16.381470 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:50:16.383997 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:50:16.383997 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:50:16.383997 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:50:16.383997 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:50:16.383997 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 03 09:50:16.383997 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:50:16.383997 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 03 09:50:16.383997 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi Jun 03 09:50:16.383997 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:50:16.383997 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi Jun 03 09:50:16.383997 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:50:16.383997 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:50:16.383997 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:50:16.383997 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:50:16.383997 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:50:16.383997 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 03 09:50:16.383997 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: ERROR nova.api.openstack.wsgi Jun 03 09:50:16.383997 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi [None req-a9bb7a67-5d7a-43d7-b6ce-789dcc147e8d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:50:16.385515 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: INFO nova.api.openstack.requestlog [None req-a9bb7a67-5d7a-43d7-b6ce-789dcc147e8d admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012166 Jun 03 09:50:16.385515 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: [pid: 103066|app: 0|req: 27/52] 10.222.0.45 () {60 vars in 1193 bytes} [Fri Jun 3 09:50:16 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 03 09:50:17.238022 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi [None req-8c518dd5-38ae-4ff3-bcd2-27ba06ab1034 admin admin] Calling method '>' {{(pid=103067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:50:17.239025 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: INFO nova.api.openstack.requestlog [None req-8c518dd5-38ae-4ff3-bcd2-27ba06ab1034 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 Jun 03 09:50:17.239421 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: [pid: 103067|app: 0|req: 26/53] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Jun 3 09:50:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:50:17.426938 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi [None req-bf20f384-8daa-42b4-bc45-89052d4b03d9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:50:17.444052 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: INFO nova.api.openstack.requestlog [None req-bf20f384-8daa-42b4-bc45-89052d4b03d9 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.069430 Jun 03 09:50:17.444598 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: [pid: 103066|app: 0|req: 28/54] 10.222.0.45 () {64 vars in 1235 bytes} [Fri Jun 3 09:50:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 09:50:18.310559 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi [None req-8c518dd5-38ae-4ff3-bcd2-27ba06ab1034 admin admin] Calling method '>' {{(pid=103067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:50:18.311575 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: INFO nova.api.openstack.requestlog [None req-8c518dd5-38ae-4ff3-bcd2-27ba06ab1034 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jun 03 09:50:18.311975 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: [pid: 103067|app: 0|req: 27/55] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Jun 3 09:50:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:50:18.497970 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi [None req-9f2c9baa-6012-42ed-b997-794cf6ac5640 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:50:18.514514 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: INFO nova.api.openstack.requestlog [None req-9f2c9baa-6012-42ed-b997-794cf6ac5640 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068071 Jun 03 09:50:18.515045 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: [pid: 103066|app: 0|req: 29/56] 10.222.0.45 () {64 vars in 1235 bytes} [Fri Jun 3 09:50:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 09:50:19.370413 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi [None req-8c518dd5-38ae-4ff3-bcd2-27ba06ab1034 admin admin] Calling method '>' {{(pid=103067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:50:19.371449 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: INFO nova.api.openstack.requestlog [None req-8c518dd5-38ae-4ff3-bcd2-27ba06ab1034 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Jun 03 09:50:19.371845 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: [pid: 103067|app: 0|req: 28/57] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Jun 3 09:50:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:50:19.558361 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi [None req-dd829a11-ef67-40e3-a6b5-fee20b870a14 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:50:19.575278 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: INFO nova.api.openstack.requestlog [None req-dd829a11-ef67-40e3-a6b5-fee20b870a14 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068960 Jun 03 09:50:19.575815 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: [pid: 103066|app: 0|req: 30/58] 10.222.0.45 () {64 vars in 1235 bytes} [Fri Jun 3 09:50:19 2022] POST /compute/v2.1/flavors => generated 407 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 09:50:20.428047 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi [None req-8c518dd5-38ae-4ff3-bcd2-27ba06ab1034 admin admin] Calling method '>' {{(pid=103067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:50:20.429048 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: INFO nova.api.openstack.requestlog [None req-8c518dd5-38ae-4ff3-bcd2-27ba06ab1034 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Jun 03 09:50:20.429456 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: [pid: 103067|app: 0|req: 29/59] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Jun 3 09:50:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:50:20.616863 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi [None req-dc89c3c0-de08-483a-8fc0-9f042a6cfc51 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:50:20.634042 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: INFO nova.api.openstack.requestlog [None req-dc89c3c0-de08-483a-8fc0-9f042a6cfc51 admin admin] 10.222.0.45 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.067661 Jun 03 09:50:20.634588 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: [pid: 103066|app: 0|req: 31/60] 10.222.0.45 () {64 vars in 1235 bytes} [Fri Jun 3 09:50:20 2022] POST /compute/v2.1/flavors => generated 409 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 03 09:50:21.500057 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi [None req-8c518dd5-38ae-4ff3-bcd2-27ba06ab1034 admin admin] Calling method '>' {{(pid=103067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:50:21.501052 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: INFO nova.api.openstack.requestlog [None req-8c518dd5-38ae-4ff3-bcd2-27ba06ab1034 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Jun 03 09:50:21.501441 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: [pid: 103067|app: 0|req: 30/61] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Jun 3 09:50:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:50:21.694710 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi [None req-e413a953-4002-4a38-ab70-ac8913e663c9 admin admin] Calling method '>' {{(pid=103066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:50:21.713625 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: INFO nova.api.openstack.requestlog [None req-e413a953-4002-4a38-ab70-ac8913e663c9 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.076513 Jun 03 09:50:21.714198 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: [pid: 103066|app: 0|req: 32/62] 10.222.0.45 () {60 vars in 1202 bytes} [Fri Jun 3 09:50:21 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:51:22.731914 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi [None req-8c518dd5-38ae-4ff3-bcd2-27ba06ab1034 admin admin] Calling method '>' {{(pid=103067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:51:22.732916 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: INFO nova.api.openstack.requestlog [None req-8c518dd5-38ae-4ff3-bcd2-27ba06ab1034 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Jun 03 09:51:22.733339 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: [pid: 103067|app: 0|req: 31/63] 10.222.0.45 () {54 vars in 930 bytes} [Fri Jun 3 09:51:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:51:22.744192 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG dbcounter [-] [103066] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:51:22.792876 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi [None req-579ae0c7-b840-409c-bd17-f7b73695f973 admin admin] Calling method '>' {{(pid=103066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:51:22.811851 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: INFO nova.api.openstack.requestlog [None req-579ae0c7-b840-409c-bd17-f7b73695f973 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.072571 Jun 03 09:51:22.812396 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: [pid: 103066|app: 0|req: 33/64] 10.222.0.45 () {60 vars in 1291 bytes} [Fri Jun 3 09:51:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:51:22.833707 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG dbcounter [-] [103067] Writing DB stats nova_api:SELECT=14 {{(pid=103067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:51:22.837357 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi [None req-05cb151c-2951-40f3-9ffe-d957a644e18b admin admin] Calling method '>' {{(pid=103067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:51:22.844979 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: INFO nova.api.openstack.requestlog [None req-05cb151c-2951-40f3-9ffe-d957a644e18b admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012659 Jun 03 09:51:22.845499 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: [pid: 103067|app: 0|req: 32/65] 10.222.0.45 () {60 vars in 1282 bytes} [Fri Jun 3 09:51:22 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:51:22.856532 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi [None req-ea1f775c-fe2c-4325-ad58-fa539cf02a37 admin admin] Calling method '>' {{(pid=103066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:51:22.864042 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: INFO nova.api.openstack.requestlog [None req-ea1f775c-fe2c-4325-ad58-fa539cf02a37 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011070 Jun 03 09:51:22.864556 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: [pid: 103066|app: 0|req: 34/66] 10.222.0.45 () {60 vars in 1285 bytes} [Fri Jun 3 09:51:22 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:51:22.875098 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi [None req-0e2bf32d-f482-425f-8f35-2f462d6ced17 admin admin] Calling method '>' {{(pid=103067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:51:22.882893 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: INFO nova.api.openstack.requestlog [None req-0e2bf32d-f482-425f-8f35-2f462d6ced17 admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011196 Jun 03 09:51:22.883397 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: [pid: 103067|app: 0|req: 33/67] 10.222.0.45 () {60 vars in 1285 bytes} [Fri Jun 3 09:51:22 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:51:22.894695 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi [None req-b46d77eb-43c0-4dc1-93f2-e741031fddae admin admin] Calling method '>' {{(pid=103066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:51:22.902411 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: INFO nova.api.openstack.requestlog [None req-b46d77eb-43c0-4dc1-93f2-e741031fddae admin admin] 10.222.0.45 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011447 Jun 03 09:51:22.902930 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: [pid: 103066|app: 0|req: 35/68] 10.222.0.45 () {60 vars in 1282 bytes} [Fri Jun 3 09:51:22 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:54:37.147095 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi [None req-0e2bf32d-f482-425f-8f35-2f462d6ced17 admin admin] Calling method '>' {{(pid=103067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:54:37.148101 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: INFO nova.api.openstack.requestlog [None req-0e2bf32d-f482-425f-8f35-2f462d6ced17 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jun 03 09:54:37.148498 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: [pid: 103067|app: 0|req: 34/69] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Jun 3 09:54:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:54:37.301742 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG dbcounter [-] [103066] Writing DB stats nova_api:SELECT=6 {{(pid=103066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:54:37.413848 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi [None req-8cdd6ad7-4c9f-4a8f-801f-c8f692477b2d admin admin] Calling method '>' {{(pid=103066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:54:37.415005 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 09:54:37.415005 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: warnings.warn(msg) Jun 03 09:54:37.416188 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG oslo_concurrency.lockutils [None req-8cdd6ad7-4c9f-4a8f-801f-c8f692477b2d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:54:37.416628 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG oslo_concurrency.lockutils [None req-8cdd6ad7-4c9f-4a8f-801f-c8f692477b2d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:54:37.417403 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG oslo_concurrency.lockutils [None req-8cdd6ad7-4c9f-4a8f-801f-c8f692477b2d admin admin] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:54:37.417853 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG oslo_concurrency.lockutils [None req-8cdd6ad7-4c9f-4a8f-801f-c8f692477b2d admin admin] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:54:37.451795 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: INFO nova.api.openstack.requestlog [None req-8cdd6ad7-4c9f-4a8f-801f-c8f692477b2d admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.152137 Jun 03 09:54:37.452346 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: [pid: 103066|app: 0|req: 36/70] 10.222.0.45 () {60 vars in 1193 bytes} [Fri Jun 3 09:54:37 2022] GET /compute/v2.1/os-services => generated 794 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 09:54:38.322312 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi [None req-0e2bf32d-f482-425f-8f35-2f462d6ced17 admin admin] Calling method '>' {{(pid=103067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:54:38.323435 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: INFO nova.api.openstack.requestlog [None req-0e2bf32d-f482-425f-8f35-2f462d6ced17 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001575 Jun 03 09:54:38.323929 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: [pid: 103067|app: 0|req: 35/71] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Jun 3 09:54:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:54:38.521806 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi [None req-738fed99-910b-44cf-8c48-ba1978afac8a admin admin] Calling method '>' {{(pid=103066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:54:38.522977 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 09:54:38.522977 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: warnings.warn(msg) Jun 03 09:54:38.524319 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG oslo_concurrency.lockutils [None req-738fed99-910b-44cf-8c48-ba1978afac8a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:54:38.524790 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG oslo_concurrency.lockutils [None req-738fed99-910b-44cf-8c48-ba1978afac8a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:54:38.525593 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG oslo_concurrency.lockutils [None req-738fed99-910b-44cf-8c48-ba1978afac8a admin admin] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:54:38.526056 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG oslo_concurrency.lockutils [None req-738fed99-910b-44cf-8c48-ba1978afac8a admin admin] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:54:38.547293 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: INFO nova.api.openstack.requestlog [None req-738fed99-910b-44cf-8c48-ba1978afac8a admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.081263 Jun 03 09:54:38.547791 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: [pid: 103066|app: 0|req: 37/72] 10.222.0.45 () {60 vars in 1193 bytes} [Fri Jun 3 09:54:38 2022] GET /compute/v2.1/os-services => generated 794 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 09:54:49.839695 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi [None req-0e2bf32d-f482-425f-8f35-2f462d6ced17 admin admin] Calling method '>' {{(pid=103067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:54:49.840703 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: INFO nova.api.openstack.requestlog [None req-0e2bf32d-f482-425f-8f35-2f462d6ced17 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Jun 03 09:54:49.841103 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: [pid: 103067|app: 0|req: 36/73] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Jun 3 09:54:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:54:49.984057 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG dbcounter [-] [103066] Writing DB stats nova_cell0:SELECT=4 {{(pid=103066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:54:49.984759 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG dbcounter [-] [103066] Writing DB stats nova_cell1:SELECT=4 {{(pid=103066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:54:49.985355 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG dbcounter [-] [103066] Writing DB stats nova_api:SELECT=8 {{(pid=103066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:54:50.032939 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi [None req-437b6325-c4e7-414d-8cf1-770dc2b32398 admin admin] Calling method '>' {{(pid=103066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:54:50.034787 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 09:54:50.034787 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: warnings.warn(msg) Jun 03 09:54:50.035969 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG oslo_concurrency.lockutils [None req-437b6325-c4e7-414d-8cf1-770dc2b32398 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:54:50.036440 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG oslo_concurrency.lockutils [None req-437b6325-c4e7-414d-8cf1-770dc2b32398 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:54:50.037249 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG oslo_concurrency.lockutils [None req-437b6325-c4e7-414d-8cf1-770dc2b32398 admin admin] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:54:50.037680 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG oslo_concurrency.lockutils [None req-437b6325-c4e7-414d-8cf1-770dc2b32398 admin admin] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:54:50.062867 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: INFO nova.api.openstack.requestlog [None req-437b6325-c4e7-414d-8cf1-770dc2b32398 admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.083161 Jun 03 09:54:50.063363 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: [pid: 103066|app: 0|req: 38/74] 10.222.0.45 () {60 vars in 1193 bytes} [Fri Jun 3 09:54:49 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:54:50.937416 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: DEBUG nova.api.openstack.wsgi [None req-0e2bf32d-f482-425f-8f35-2f462d6ced17 admin admin] Calling method '>' {{(pid=103067) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:54:50.938519 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: INFO nova.api.openstack.requestlog [None req-0e2bf32d-f482-425f-8f35-2f462d6ced17 admin admin] 10.222.0.45 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Jun 03 09:54:50.938926 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: [pid: 103067|app: 0|req: 37/75] 10.222.0.45 () {56 vars in 1074 bytes} [Fri Jun 3 09:54:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:54:51.127294 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG nova.api.openstack.wsgi [None req-d01777a9-bae8-4759-8b98-820292dac80e admin admin] Calling method '>' {{(pid=103066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:54:51.128453 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 03 09:54:51.128453 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: warnings.warn(msg) Jun 03 09:54:51.129627 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG oslo_concurrency.lockutils [None req-d01777a9-bae8-4759-8b98-820292dac80e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:54:51.130093 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG oslo_concurrency.lockutils [None req-d01777a9-bae8-4759-8b98-820292dac80e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:54:51.130880 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG oslo_concurrency.lockutils [None req-d01777a9-bae8-4759-8b98-820292dac80e admin admin] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:54:51.131311 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: DEBUG oslo_concurrency.lockutils [None req-d01777a9-bae8-4759-8b98-820292dac80e admin admin] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:54:51.153313 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: INFO nova.api.openstack.requestlog [None req-d01777a9-bae8-4759-8b98-820292dac80e admin admin] 10.222.0.45 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.077162 Jun 03 09:54:51.154118 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: [pid: 103066|app: 0|req: 39/76] 10.222.0.45 () {60 vars in 1193 bytes} [Fri Jun 3 09:54:51 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:55:48.760921 dv-cinder-797608-29-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 03 09:55:48.761490 dv-cinder-797608-29-iscsi devstack@n-api.service[103065]: Fri Jun 3 09:55:48 2022 - graceful shutdown triggered... Jun 03 09:55:48.761986 dv-cinder-797608-29-iscsi devstack@n-api.service[103067]: Gracefully killing worker 2 (pid: 103067)... Jun 03 09:55:48.762352 dv-cinder-797608-29-iscsi devstack@n-api.service[103066]: Gracefully killing worker 1 (pid: 103066)... Jun 03 09:55:49.762676 dv-cinder-797608-29-iscsi devstack@n-api.service[103065]: worker 1 buried after 1 seconds Jun 03 09:55:49.763199 dv-cinder-797608-29-iscsi devstack@n-api.service[103065]: worker 2 buried after 1 seconds Jun 03 09:55:49.763199 dv-cinder-797608-29-iscsi devstack@n-api.service[103065]: goodbye to uWSGI. Jun 03 09:55:49.764299 dv-cinder-797608-29-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 03 09:55:49.764883 dv-cinder-797608-29-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 03 09:55:49.767564 dv-cinder-797608-29-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 03 09:55:49.779856 dv-cinder-797608-29-iscsi devstack@n-api.service[117635]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 03 09:55:49.816185 dv-cinder-797608-29-iscsi devstack@n-api.service[117635]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 3 09:55:49 2022] *** Jun 03 09:55:49.816185 dv-cinder-797608-29-iscsi devstack@n-api.service[117635]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 03 09:55:49.816185 dv-cinder-797608-29-iscsi devstack@n-api.service[117635]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 03 09:55:49.816185 dv-cinder-797608-29-iscsi devstack@n-api.service[117635]: nodename: dv-cinder-797608-29-iscsi Jun 03 09:55:49.816185 dv-cinder-797608-29-iscsi devstack@n-api.service[117635]: machine: x86_64 Jun 03 09:55:49.816185 dv-cinder-797608-29-iscsi devstack@n-api.service[117635]: clock source: unix Jun 03 09:55:49.816185 dv-cinder-797608-29-iscsi devstack@n-api.service[117635]: pcre jit disabled Jun 03 09:55:49.816185 dv-cinder-797608-29-iscsi devstack@n-api.service[117635]: detected number of CPU cores: 4 Jun 03 09:55:49.816185 dv-cinder-797608-29-iscsi devstack@n-api.service[117635]: current working directory: / Jun 03 09:55:49.816185 dv-cinder-797608-29-iscsi devstack@n-api.service[117635]: detected binary path: /usr/bin/uwsgi-core Jun 03 09:55:49.816185 dv-cinder-797608-29-iscsi devstack@n-api.service[117635]: your processes number limit is 47680 Jun 03 09:55:49.816185 dv-cinder-797608-29-iscsi devstack@n-api.service[117635]: your memory page size is 4096 bytes Jun 03 09:55:49.816185 dv-cinder-797608-29-iscsi devstack@n-api.service[117635]: detected max file descriptor number: 2048 Jun 03 09:55:49.817214 dv-cinder-797608-29-iscsi devstack@n-api.service[117635]: lock engine: pthread robust mutexes Jun 03 09:55:49.817214 dv-cinder-797608-29-iscsi devstack@n-api.service[117635]: thunder lock: enabled Jun 03 09:55:49.817214 dv-cinder-797608-29-iscsi devstack@n-api.service[117635]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 03 09:55:49.817214 dv-cinder-797608-29-iscsi devstack@n-api.service[117635]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 03 09:55:49.867142 dv-cinder-797608-29-iscsi devstack@n-api.service[117635]: Python main interpreter initialized at 0x55d885e989c0 Jun 03 09:55:49.867142 dv-cinder-797608-29-iscsi devstack@n-api.service[117635]: python threads support enabled Jun 03 09:55:49.867142 dv-cinder-797608-29-iscsi devstack@n-api.service[117635]: your server socket listen backlog is limited to 100 connections Jun 03 09:55:49.867142 dv-cinder-797608-29-iscsi devstack@n-api.service[117635]: your mercy for graceful operations on workers is 90 seconds Jun 03 09:55:49.867613 dv-cinder-797608-29-iscsi devstack@n-api.service[117635]: mapped 403077 bytes (393 KB) for 2 cores Jun 03 09:55:49.867613 dv-cinder-797608-29-iscsi devstack@n-api.service[117635]: *** Operational MODE: preforking *** Jun 03 09:55:49.867871 dv-cinder-797608-29-iscsi devstack@n-api.service[117635]: *** uWSGI is running in multiple interpreter mode *** Jun 03 09:55:49.867871 dv-cinder-797608-29-iscsi devstack@n-api.service[117635]: spawned uWSGI master process (pid: 117635) Jun 03 09:55:49.868083 dv-cinder-797608-29-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 03 09:55:49.868982 dv-cinder-797608-29-iscsi devstack@n-api.service[117635]: spawned uWSGI worker 1 (pid: 117647, cores: 1) Jun 03 09:55:49.869783 dv-cinder-797608-29-iscsi devstack@n-api.service[117635]: spawned uWSGI worker 2 (pid: 117648, cores: 1) Jun 03 09:55:49.869783 dv-cinder-797608-29-iscsi devstack@n-api.service[117635]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 03 09:55:51.119054 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 03 09:55:51.119962 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 03 09:55:51.947774 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 09:55:51.947774 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: from cryptography.utils import int_from_bytes Jun 03 09:55:51.948115 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 09:55:51.948115 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: from cryptography.utils import int_from_bytes Jun 03 09:55:51.948483 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 09:55:51.948483 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: from cryptography.utils import int_from_bytes Jun 03 09:55:51.948773 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 03 09:55:51.948773 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: from cryptography.utils import int_from_bytes Jun 03 09:55:54.370870 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 03 09:55:54.371458 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 03 09:55:54.371726 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 03 09:55:54.371945 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 03 09:55:54.372210 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 03 09:55:54.372607 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.372941 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.373271 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.373598 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.373963 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.374296 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.374617 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.374952 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.375290 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.375559 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.380804 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.380804 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-29-iscsi {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.380804 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.380804 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.380804 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.380804 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.380804 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.380804 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.381433 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.381433 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.381433 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.381433 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.381433 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.381433 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.381862 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.381862 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.381862 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.382347 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.382470 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.382746 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.383145 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-29-iscsi {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.383568 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.383782 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.384102 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.384518 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.384847 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.385162 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.385485 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.385858 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.386171 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.386500 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.386829 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.387158 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.387482 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.387792 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.388107 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.388426 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.388767 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.389072 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.389383 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.389640 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.389986 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.393789 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.393789 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.393789 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.393789 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.393789 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.393789 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.394261 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.394261 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.394261 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.394261 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.394261 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.394261 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.394660 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.394945 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.395113 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.395509 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.395731 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.396069 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.396383 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.396712 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.397120 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.397379 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.397702 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.398075 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.398404 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.398723 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.399052 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.399382 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.399701 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.400017 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.400337 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.400661 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.401004 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.401317 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.401574 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.401907 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.402223 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.402553 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.402868 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.403183 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.403497 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.403802 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.404120 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.404693 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.405507 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.405507 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.405653 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.405943 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.406257 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.406570 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.406882 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.407208 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.407538 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.407853 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.408167 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.408524 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.408865 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.409173 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.409485 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.409818 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.410151 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.410464 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.410775 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.411099 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.411414 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.411728 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.412052 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.412359 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.412673 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.412997 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.413310 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.413621 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.413971 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.414281 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.414592 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.414906 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.415217 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.415527 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.415832 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.416160 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.416489 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.416808 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.417119 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.417437 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.417789 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.418131 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.418473 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.418827 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.419149 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.419324 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 03 09:55:54.419809 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 03 09:55:54.419983 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.419983 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.420284 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 03 09:55:54.420439 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.420625 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 03 09:55:54.420787 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.420943 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 03 09:55:54.421087 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.421229 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.421380 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.421532 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.421686 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.421917 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.422075 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.422226 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.422376 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.422376 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.422666 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.422820 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.422962 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.422962 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.423248 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.423248 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.423611 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.423763 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.423935 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.423935 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.424230 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.424380 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.424537 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.424690 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-29-iscsi {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.424832 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.424983 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.425125 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.425280 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.425424 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.425567 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.425727 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.425996 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.426146 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.426853 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.427007 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.427160 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.427312 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.427474 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.427621 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.427621 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.427931 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.428291 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.428443 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.428595 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.428748 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.428900 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.429050 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.429193 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.429344 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.429493 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.429652 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.429851 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.430012 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.430164 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.430318 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.430460 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.430612 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.430754 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.430904 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.431053 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.431196 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.431338 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.431489 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-29-iscsi {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.431633 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.431775 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.431917 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.432074 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.432238 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.432381 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.432524 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.432666 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.432816 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.432968 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.433119 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.433261 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.433410 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.433560 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.433703 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.433703 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.434026 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.434179 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.434321 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.434463 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.434612 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.434763 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.434916 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.435067 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.435209 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.435351 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.435507 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.435655 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.435803 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.435962 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.436105 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.436255 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.436411 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.437043 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.437206 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.437351 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.437501 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.437655 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.437833 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.437989 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.438152 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.438505 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.438674 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.438829 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.438982 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.439263 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.439414 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.440052 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.440202 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.440202 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.440497 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.440639 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.440790 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.440939 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.441093 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.441249 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.441394 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.441535 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.441684 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.441893 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.442053 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.442197 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.442338 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.442488 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.442637 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.442779 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.443054 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.443200 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.443341 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.443484 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.443633 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.443788 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.443949 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.444093 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.444233 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.444382 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.444531 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.444681 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.444837 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.444991 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.445140 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.445290 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.445431 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.445582 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.45 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.445733 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.445899 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.45 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.446053 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.446196 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.446345 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.446498 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.446903 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.447304 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.447459 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.447603 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.447755 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.447914 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.448078 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.448230 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.448589 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.448743 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.448886 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.449028 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.449181 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.449418 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.449580 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.449580 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.449900 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.450052 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.450209 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.450352 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.450502 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.450502 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.450779 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.450930 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.451083 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.451225 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.451366 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.451518 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.451661 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.451894 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.452040 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.452188 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.452330 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.452480 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.452629 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.452783 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.452928 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.453079 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.453230 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.453372 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.453646 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.453859 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.454069 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.454219 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.454371 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.454521 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.454663 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.454820 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.454963 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.455107 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.455295 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.455441 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.455597 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.455763 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.455914 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.456066 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.456209 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.456349 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.456509 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.456724 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.457036 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.457455 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.457615 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.457785 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.457954 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.458100 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.458254 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.458410 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.458761 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.458911 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.459054 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.459205 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.459348 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.459589 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.459734 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.459876 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.460018 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.460168 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.460168 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.460465 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.460609 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.460750 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.460898 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.461040 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.461234 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.461380 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.461529 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.461679 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.461894 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.462048 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.462204 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.462374 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.462517 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.462667 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.462667 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.462945 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.463095 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.463245 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.463388 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.463530 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.463678 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.463833 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.463994 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.464149 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.464301 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.464444 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.464592 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.464749 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.464749 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.465018 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.465018 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.465285 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.465434 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.465586 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.465736 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.465903 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.465903 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.466206 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.466356 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.466508 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.466659 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 03 09:55:54.466802 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.466802 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.467519 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.467686 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.467844 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.467999 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.468142 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.468284 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.468438 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.468594 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.468975 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.469130 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.469280 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.469431 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.469665 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.469882 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.470030 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.470180 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.470322 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.470464 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.470606 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.471294 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.471450 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.471601 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.471751 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.471977 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.472137 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.472292 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.472446 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.472588 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.472730 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.472880 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.473032 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.473182 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.473335 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.473485 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.473639 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.473804 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.473973 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.474119 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.474261 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.474404 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.474545 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.474695 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.474847 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.474999 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.475149 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.475311 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.475453 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.475603 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.475603 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.475883 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.476034 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.476183 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.476332 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.476492 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.476635 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.476777 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.476926 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.477239 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.477408 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.477851 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.478012 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.478165 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.478307 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.478456 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.478951 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.479120 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.479273 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.479433 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.479650 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.479900 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.480066 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.480227 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.480370 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.480521 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.480664 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.480806 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.480958 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.481101 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.481244 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.481395 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.481538 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.481681 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.481902 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.482072 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.482218 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.482369 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.482512 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.482653 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.482876 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.483022 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.483164 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.483323 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.483475 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.483624 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.483783 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.483936 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.484101 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.484252 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.484252 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.484570 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.484762 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.485439 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.485602 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.485783 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.485948 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.486109 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.486261 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.486469 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.486632 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.486776 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.486919 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.487070 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.487378 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.487530 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.487844 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.487995 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.488146 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.488305 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.488466 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.488697 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.488873 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.489240 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.489393 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.489548 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.489700 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.490425 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.490600 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.490748 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.490891 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.491044 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.491187 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.491329 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.491482 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.491639 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.491801 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.491953 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.492096 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.492246 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.492404 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.492548 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.492690 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.492834 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.492976 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.493127 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.493278 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.493429 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.493585 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.493739 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.493914 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.494074 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.494226 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.494376 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.494519 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.494661 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.494879 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.495041 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.495193 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.495344 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.495495 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.495648 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.495648 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.495932 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.496083 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.496226 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.496367 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.496518 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.496680 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.496680 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.496975 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.497133 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.497434 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.497594 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.497901 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.498076 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.498228 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.498385 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.498534 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.498691 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.498870 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.499308 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.499474 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.499633 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.499782 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.499941 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.500099 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.500260 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.500417 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.500566 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.500730 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.500901 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.501051 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.501201 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.501349 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.501506 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.501655 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.501839 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.502519 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.502676 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.502827 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.502969 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.502969 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.502969 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.502969 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.502969 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.503656 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.503805 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.503805 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.504097 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.504246 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.504410 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.504564 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.504564 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.504847 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.504999 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.505142 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.505283 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.505433 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.505576 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.505727 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.505904 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.506048 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.506190 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.506190 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.506490 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.506641 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.506785 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.506926 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.507068 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.507209 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.507359 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.507663 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.507829 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.508059 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.508209 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.508351 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.508505 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.508661 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.508812 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.508955 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.509140 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.509617 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.509799 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.509961 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.510114 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.510257 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.510408 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.510560 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.510717 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.510860 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.511015 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.511158 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.511301 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.511452 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.511604 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.511747 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.511890 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.512032 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.512182 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.512339 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.512482 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.512633 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.512633 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.512920 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.513071 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.513231 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.513381 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.513530 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.513687 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.513878 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.514039 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.514206 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.514366 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.514524 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.514674 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.514842 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.515012 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.515171 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.515320 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.515476 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.516232 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.516402 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.516636 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.516789 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.516941 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.517097 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.517247 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.517403 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.517830 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.518004 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.518255 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.518419 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.518570 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.518727 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.518898 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.519058 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.519208 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.519208 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.519840 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.519993 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.520158 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.520321 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.520477 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.520635 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.520824 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.520989 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.521149 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.521299 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.521447 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.521604 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.521884 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.522057 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.522210 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.522367 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.522529 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.522686 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.522880 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.523046 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.523207 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.523357 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.523506 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.523655 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.523811 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.523982 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.524132 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.524287 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.524460 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.524619 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.524847 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.525008 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.525158 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.525308 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.525457 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.525605 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.525803 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.525961 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.526121 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.526271 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.526542 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.526729 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.526896 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.527047 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.527205 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.527355 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.527504 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.527652 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.527652 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.528114 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.528289 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.528513 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.528677 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.528845 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.529015 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.529166 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.529315 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.529991 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.530152 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.530324 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.530483 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.530641 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.530798 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.530948 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.530948 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.531251 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.531401 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.531562 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.531711 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.531868 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.532025 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.532183 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.532342 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.532498 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.532649 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.532806 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.532969 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.533126 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.533321 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.533484 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.533635 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.533866 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.534038 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.534189 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.534345 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.534498 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.534655 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.534806 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.534969 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.535127 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.535284 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.535450 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.535610 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.535768 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.535935 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.536085 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.536234 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.536382 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.536530 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.536688 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.536839 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.536987 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.537136 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.537285 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.537442 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.537614 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.537614 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.538078 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.538235 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.538392 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.538634 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.538805 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.538959 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.538959 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.539243 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.539243 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.539526 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.539697 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.540146 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.540305 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.541049 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.541218 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.541371 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.541538 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.541697 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.541907 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.542061 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.542219 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.542395 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.542556 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.542707 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.542863 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.543013 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.543172 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.543331 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.543489 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.543690 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.543853 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.544055 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.544212 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.544382 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.544545 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.544694 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.544860 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.545011 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.545163 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.545323 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.545473 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.545630 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.545815 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.546007 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.546177 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.546339 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.546490 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.546660 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.546811 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.546960 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.547127 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.547278 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.547436 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.547436 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.547730 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.547888 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.548207 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.548365 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.548523 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.548523 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.549462 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.549623 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.549816 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.550315 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.550475 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.550639 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.550639 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.550639 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.551093 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.551245 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.551394 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.551545 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.551707 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.551866 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.552025 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.552185 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.552185 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.552469 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.552627 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.554078 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.554220 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.554313 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.554397 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.554480 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.554562 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.554562 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.554707 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.554788 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.554868 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.554941 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.555022 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.555103 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.555103 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.555103 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.555305 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.555385 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.555540 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.555623 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.555705 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.555786 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.555858 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.555929 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.556009 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.556092 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.556165 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.556235 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.556305 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.556305 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.556448 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.556521 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.556591 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.556661 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.556730 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.556827 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.556916 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.556991 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.557061 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.557145 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.557220 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.557220 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.557359 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.557430 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.557501 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.557571 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.557642 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.557735 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.557869 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.557953 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.558027 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.558107 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.558182 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.558262 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.558335 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.558413 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.558494 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.558574 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.558656 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.558730 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.558800 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.558870 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.558948 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.559031 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.559119 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.559193 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.559287 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.559360 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.559430 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.559508 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.559671 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.559760 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.559841 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.559927 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.560013 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.560100 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.560189 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.560263 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.560333 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.560410 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.560489 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.560571 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.560644 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.560644 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.560797 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.560882 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.560973 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.561068 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.561153 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.561153 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.561153 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.561153 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.561438 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.561536 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.561688 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.561806 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.561898 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.561986 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.562251 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.562363 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.562451 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.562536 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.562636 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.562739 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.562826 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.562910 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.562994 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.563078 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.563161 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.563255 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.563348 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.563348 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.563520 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.563613 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.563713 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.563799 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.563891 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.563977 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.564068 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.564163 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.564261 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.564361 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.564448 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.564532 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.564615 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.564699 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.564795 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.564883 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.564967 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.565061 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.565155 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.565250 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.565351 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.565438 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.565522 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.565614 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.565699 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.565855 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.565952 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.566234 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.566343 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.566558 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.566662 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.566870 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.566973 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.567184 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.567277 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.567514 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.567618 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.567834 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.567928 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.568151 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.568244 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.568479 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.568637 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.568810 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.568902 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.569134 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.569223 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.569444 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.569583 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.569798 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.569920 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.570095 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.570220 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.570420 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.570556 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.570820 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.570912 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.571041 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.571142 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.571357 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.571470 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.571671 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.571771 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.571989 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.572092 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.572307 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.572401 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.572624 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.572716 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.572936 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.573034 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.573251 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.573351 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.573568 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.573668 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.573914 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.574021 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.574248 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.574448 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.574549 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.574771 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.574862 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.575118 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.575218 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.575455 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.575545 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.575771 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.575870 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.576082 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.576174 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.576410 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.576525 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.576751 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.576851 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.577067 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.577159 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.577382 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.577482 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.577703 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.577902 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.578047 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.578147 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.578360 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.578460 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.578685 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.578797 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.578993 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.579085 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.579330 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.579451 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.579629 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.579736 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.579948 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.580041 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.580842 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.581023 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.581203 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.581372 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.581528 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.581681 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.581922 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.582091 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.582260 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.582435 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.582589 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.582748 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.582910 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.583071 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.583235 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.583441 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.583615 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.583781 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.583935 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.584128 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.584299 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.584460 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.584625 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.584775 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.584927 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.585097 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.585271 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.585434 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.585605 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.585779 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.585950 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.586121 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.586275 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.586444 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.586609 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.586778 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.586932 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.587093 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.587255 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.587408 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.587567 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.587720 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.587881 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.588046 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.588201 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.588353 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.588512 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.588686 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.588839 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.589005 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.589166 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.589327 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.589650 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.589831 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.590009 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.590172 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.590327 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.590487 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.590487 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.591018 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.591217 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.591387 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.591611 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.591774 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.591935 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.592089 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.592252 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.592407 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.592560 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.592719 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.592881 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.593041 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.593218 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.593380 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.593543 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.593703 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.593885 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.594053 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.594215 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.594376 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.594530 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.594683 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.594843 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.595010 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.595170 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.595337 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.595492 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.595652 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.595875 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.596042 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.596042 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.596341 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.596493 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.596654 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.596807 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.596969 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.597122 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.597122 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.597429 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.597429 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.597742 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.597742 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.598075 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.598075 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.598364 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.598516 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.598687 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.598841 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.599002 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.599153 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.599305 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.599475 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.599822 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.599984 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.600139 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.600299 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.600453 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.600605 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.600769 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.600950 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.601124 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.601278 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.601431 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.601610 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.601784 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.601945 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.602099 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.602261 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.602422 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.602589 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.602743 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.602905 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.603058 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.603217 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.603372 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.603533 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.603697 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.603856 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.604011 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.604163 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.604324 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.604476 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.604628 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.604788 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.604950 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.605102 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.605275 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.605429 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.605605 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.605785 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.605946 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.606111 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.606276 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.606429 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.606582 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.606742 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.606895 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.607055 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.607225 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.607378 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.607530 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.607693 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.607855 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.607855 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.608165 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.608318 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.608470 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.608630 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.608783 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.608944 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.609098 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.609259 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.609412 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.609570 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.609867 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.610056 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.610219 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.610382 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.610535 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.610701 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.610866 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.611026 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.611180 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.611841 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.612011 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.612166 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.612339 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.612493 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.612645 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.612806 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.612958 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.613110 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.613275 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.613429 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.613581 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.613732 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.613908 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.614061 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.614226 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.614391 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.614543 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.614695 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.614854 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.615017 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.615183 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.615340 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.615502 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.615655 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.615807 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.615974 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.616134 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.616301 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.616453 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.616605 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.616756 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.616917 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.617070 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.617070 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.617365 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.617518 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.617668 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.617872 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.618040 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.618193 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.618363 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.618516 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.618678 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.618838 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.618991 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.619143 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.619294 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.619446 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.619612 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.619767 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.619937 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.620165 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.620323 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.620486 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.620486 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.620800 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.620992 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.621161 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.621314 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.621467 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.621628 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.621813 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.621973 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.622127 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.622279 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.622457 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.622622 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.622783 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.622946 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.623098 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.623251 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.623420 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.623582 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.623743 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.623908 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.624061 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.624226 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.624389 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.624552 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.624704 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.624856 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.625008 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.625181 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.625339 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.625500 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.625660 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.625844 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.626015 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.626179 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.626340 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.626511 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.626665 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.626817 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.627005 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.627689 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.627846 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.627999 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.628153 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.628314 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.628487 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.628648 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.628802 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.628973 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.629137 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.629298 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.629460 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.629620 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.629799 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.629969 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.630140 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.630140 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.630510 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.630510 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.630807 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.630970 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.631122 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.631284 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.631436 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.631597 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.631749 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.631901 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.632052 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.632215 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.632368 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.632527 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.632688 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.632841 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.633013 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.633175 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.633328 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.633488 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.633649 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.633887 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.634059 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.634215 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.634369 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.634520 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.634681 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.634841 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.635008 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.635187 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.635354 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.635525 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.635678 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.635829 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.635991 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.636143 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.636306 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.636468 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.636468 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117648) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 03 09:55:54.636758 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.636758 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.636758 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.636758 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.636758 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.636758 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.636758 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.637814 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.637814 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.637814 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.638343 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.638343 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.638655 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.638807 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.639070 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.639383 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.639693 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.640009 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.640318 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.640651 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.640964 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.641280 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.641592 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.641932 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.642246 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.642555 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.642892 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.643202 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.643520 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.643830 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.644145 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.644455 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.644773 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.645084 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.645399 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.645788 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.646124 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.646436 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.646745 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.647067 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.647382 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.647713 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.648033 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.648350 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.648703 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.649029 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.649573 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.649939 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.650314 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.650606 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.650945 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.651268 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.651580 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.651892 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.652221 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.652538 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.652851 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.653168 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.653485 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.653820 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.654165 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.654742 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.655058 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.655371 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.655685 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.656000 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.656313 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.656627 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.656949 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.657296 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.657619 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.657968 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.658316 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.658641 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.658957 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.659275 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.659592 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.659905 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.660227 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.660566 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.660884 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.661202 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.661629 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.661976 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.662299 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.662627 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.662942 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.663271 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.663627 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.663945 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.664273 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.664589 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.664926 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.665296 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.665633 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.665990 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.666302 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.666612 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.666923 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.667238 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.667563 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.667876 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.668186 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.668492 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.668806 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.669114 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.669421 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.669729 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.670059 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.670371 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.670679 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.670986 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.671296 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.671605 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.671912 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.672239 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.672535 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.672842 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.673153 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.673461 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.673811 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.674644 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.674985 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.675328 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.675649 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.675978 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.676297 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.676630 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.676949 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.677273 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.677603 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.677945 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.678270 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.678654 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.678960 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.679282 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.679601 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.679918 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.680233 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.680548 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.680884 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.681225 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.681539 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.681897 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.682615 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.682615 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.682938 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.683150 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.683534 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.683968 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.684288 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.684613 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.684932 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.685251 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.685575 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.685925 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.686264 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.686600 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.686918 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.687321 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.687584 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.687942 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.688263 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.688616 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.688953 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.689274 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.689668 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.690011 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 03 09:55:54.690263 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117647) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 03 09:55:54.698217 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO dbcounter [None req-0842a619-6845-4870-ade5-0e5fffbe5fe6 None None] Registered counter for database nova_api Jun 03 09:55:54.721598 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_db.sqlalchemy.engines [None req-0842a619-6845-4870-ade5-0e5fffbe5fe6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117648) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 09:55:54.728319 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writer thread running {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 09:55:54.750937 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO dbcounter [None req-2cc7faa3-abe0-446c-903c-5c04a664cb22 None None] Registered counter for database nova_api Jun 03 09:55:54.770901 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_db.sqlalchemy.engines [None req-2cc7faa3-abe0-446c-903c-5c04a664cb22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117647) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 09:55:54.777850 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writer thread running {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 09:55:54.787529 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.context [None req-0842a619-6845-4870-ade5-0e5fffbe5fe6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2c987095-b86e-48e2-b785-0c700e5d563a(cell1) {{(pid=117648) load_cells /opt/stack/nova/nova/context.py:464}} Jun 03 09:55:54.791911 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0842a619-6845-4870-ade5-0e5fffbe5fe6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:55:54.793536 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0842a619-6845-4870-ade5-0e5fffbe5fe6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:55:54.794416 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0842a619-6845-4870-ade5-0e5fffbe5fe6 None None] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:55:54.796375 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0842a619-6845-4870-ade5-0e5fffbe5fe6 None None] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:55:54.798372 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO dbcounter [None req-0842a619-6845-4870-ade5-0e5fffbe5fe6 None None] Registered counter for database nova_cell0 Jun 03 09:55:54.802949 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO dbcounter [None req-0842a619-6845-4870-ade5-0e5fffbe5fe6 None None] Registered counter for database nova_cell1 Jun 03 09:55:54.811102 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_db.sqlalchemy.engines [None req-0842a619-6845-4870-ade5-0e5fffbe5fe6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117648) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 09:55:54.811829 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_db.sqlalchemy.engines [None req-0842a619-6845-4870-ade5-0e5fffbe5fe6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117648) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 09:55:54.818677 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writer thread running {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 09:55:54.819977 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writer thread running {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 09:55:54.838149 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.context [None req-2cc7faa3-abe0-446c-903c-5c04a664cb22 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2c987095-b86e-48e2-b785-0c700e5d563a(cell1) {{(pid=117647) load_cells /opt/stack/nova/nova/context.py:464}} Jun 03 09:55:54.842406 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2cc7faa3-abe0-446c-903c-5c04a664cb22 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:55:54.843988 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2cc7faa3-abe0-446c-903c-5c04a664cb22 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:55:54.844829 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2cc7faa3-abe0-446c-903c-5c04a664cb22 None None] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:55:54.846870 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2cc7faa3-abe0-446c-903c-5c04a664cb22 None None] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:55:54.848844 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO dbcounter [None req-2cc7faa3-abe0-446c-903c-5c04a664cb22 None None] Registered counter for database nova_cell0 Jun 03 09:55:54.852890 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO dbcounter [None req-2cc7faa3-abe0-446c-903c-5c04a664cb22 None None] Registered counter for database nova_cell1 Jun 03 09:55:54.860087 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_db.sqlalchemy.engines [None req-2cc7faa3-abe0-446c-903c-5c04a664cb22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117647) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 09:55:54.862321 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_db.sqlalchemy.engines [None req-2cc7faa3-abe0-446c-903c-5c04a664cb22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117647) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 09:55:54.868433 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writer thread running {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 09:55:54.870517 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writer thread running {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 09:55:54.968756 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO dbcounter [None req-0842a619-6845-4870-ade5-0e5fffbe5fe6 None None] Registered counter for database nova_cell0 Jun 03 09:55:54.976294 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_db.sqlalchemy.engines [None req-0842a619-6845-4870-ade5-0e5fffbe5fe6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117648) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 09:55:54.981068 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writer thread running {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 09:55:55.023202 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO dbcounter [None req-2cc7faa3-abe0-446c-903c-5c04a664cb22 None None] Registered counter for database nova_cell0 Jun 03 09:55:55.031749 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_db.sqlalchemy.engines [None req-2cc7faa3-abe0-446c-903c-5c04a664cb22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117647) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 03 09:55:55.046124 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writer thread running {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 03 09:55:55.425305 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: WARNING keystonemiddleware.auth_token [None req-0842a619-6845-4870-ade5-0e5fffbe5fe6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 09:55:55.432651 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: WARNING keystonemiddleware.auth_token [None req-0842a619-6845-4870-ade5-0e5fffbe5fe6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 09:55:55.497273 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: WARNING keystonemiddleware.auth_token [None req-2cc7faa3-abe0-446c-903c-5c04a664cb22 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 09:55:55.509513 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: WARNING keystonemiddleware.auth_token [None req-2cc7faa3-abe0-446c-903c-5c04a664cb22 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 09:55:55.656653 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: WARNING keystonemiddleware.auth_token [None req-0842a619-6845-4870-ade5-0e5fffbe5fe6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 09:55:55.662713 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: WARNING keystonemiddleware.auth_token [None req-0842a619-6845-4870-ade5-0e5fffbe5fe6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 09:55:55.667816 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d885e989c0 pid: 117648 (default app) Jun 03 09:55:55.737593 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: WARNING keystonemiddleware.auth_token [None req-2cc7faa3-abe0-446c-903c-5c04a664cb22 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 03 09:55:55.743789 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: WARNING keystonemiddleware.auth_token [None req-2cc7faa3-abe0-446c-903c-5c04a664cb22 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 03 09:55:55.748922 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d885e989c0 pid: 117647 (default app) Jun 03 09:56:37.515431 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_api:SELECT=3 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:56:37.517404 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell1:SELECT=3 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:56:37.518396 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell0:SELECT=3 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:56:37.519794 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell0:SELECT=3 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:56:39.335832 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-8d89db64-e467-472c-8caf-1499fdb35713 tempest-VolumesSnapshotsTestJSON-1156270413 tempest-VolumesSnapshotsTestJSON-1156270413-project] Action: 'create', calling method: .version_select at 0x7f503cbd6310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1460816410"}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:56:40.995574 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_api:SELECT=3 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:56:40.996326 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=3 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:56:41.003821 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell0:SELECT=3 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:56:41.004632 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell0:SELECT=3 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:56:41.914397 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-04d2dad2-123e-4d6e-9b68-5f2f9c085c1d tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1605356132", "imageRef": "0cb3b007-4e95-448b-8acb-895d8acdb244", "flavorRef": "452", "networks": [{"uuid": "3281493a-def1-4586-a30f-eb90f9914fd2"}]}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:56:42.609548 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-8d89db64-e467-472c-8caf-1499fdb35713 tempest-VolumesSnapshotsTestJSON-1156270413 tempest-VolumesSnapshotsTestJSON-1156270413-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 5.103841 Jun 03 09:56:42.611311 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 1/1] 10.222.0.45 () {60 vars in 1154 bytes} [Fri Jun 3 09:56:37 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 5107 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 03 09:56:42.630743 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-3912a172-340b-4d6d-96e7-a57f15c5ab54 tempest-VolumesSnapshotsTestJSON-1156270413 tempest-VolumesSnapshotsTestJSON-1156270413-project] Calling method '.version_select at 0x7f503ca9d310>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:56:42.838467 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.network.neutron [None req-04d2dad2-123e-4d6e-9b68-5f2f9c085c1d tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] validate_networks() for [('3281493a-def1-4586-a30f-eb90f9914fd2', None, None, None, None, None)] {{(pid=117647) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 09:56:43.007387 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-3912a172-340b-4d6d-96e7-a57f15c5ab54 tempest-VolumesSnapshotsTestJSON-1156270413 tempest-VolumesSnapshotsTestJSON-1156270413-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/e724a7ac-6594-4041-84d9-409b034c4dc0" status: 200 len: 346 microversion: 2.1 time: 0.381691 Jun 03 09:56:43.008278 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 2/2] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Jun 3 09:56:42 2022] GET /compute/v2.1/os-volumes/e724a7ac-6594-4041-84d9-409b034c4dc0 => generated 346 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:56:43.021115 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-6ffe2b4a-bad2-4258-8508-c56c759e428d tempest-VolumesSnapshotsTestJSON-1156270413 tempest-VolumesSnapshotsTestJSON-1156270413-project] Action: 'create', calling method: .version_select at 0x7f503ca9d8b0>, body: {"snapshot": {"volume_id": "e724a7ac-6594-4041-84d9-409b034c4dc0", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2028368977"}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:56:43.742764 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-6ffe2b4a-bad2-4258-8508-c56c759e428d tempest-VolumesSnapshotsTestJSON-1156270413 tempest-VolumesSnapshotsTestJSON-1156270413-project] 10.222.0.45 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.725321 Jun 03 09:56:43.743845 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 3/3] 10.222.0.45 () {60 vars in 1161 bytes} [Fri Jun 3 09:56:43 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:56:43.754410 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-cd1df9c7-701d-44cb-aa3c-0652b8b7b89a tempest-VolumesSnapshotsTestJSON-1156270413 tempest-VolumesSnapshotsTestJSON-1156270413-project] Calling method '.version_select at 0x7f503ca9df70>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:56:43.914373 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-cd1df9c7-701d-44cb-aa3c-0652b8b7b89a tempest-VolumesSnapshotsTestJSON-1156270413 tempest-VolumesSnapshotsTestJSON-1156270413-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/2089f72f-f550-4dda-b416-6b3b92589653" status: 200 len: 287 microversion: 2.1 time: 0.162929 Jun 03 09:56:43.918725 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 4/4] 10.222.0.45 () {58 vars in 1250 bytes} [Fri Jun 3 09:56:43 2022] GET /compute/v2.1/os-snapshots/2089f72f-f550-4dda-b416-6b3b92589653 => generated 287 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:56:43.927445 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-bf1ea67a-448c-4182-93e6-13c9e3a5c117 tempest-VolumesSnapshotsTestJSON-1156270413 tempest-VolumesSnapshotsTestJSON-1156270413-project] Calling method '.version_select at 0x7f503ca39670>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:56:44.004159 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-bf1ea67a-448c-4182-93e6-13c9e3a5c117 tempest-VolumesSnapshotsTestJSON-1156270413 tempest-VolumesSnapshotsTestJSON-1156270413-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.083953 Jun 03 09:56:44.011831 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 5/5] 10.222.0.45 () {58 vars in 1139 bytes} [Fri Jun 3 09:56:43 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:56:44.016572 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-f2669f7c-1ee3-4a01-9619-420e750ed9a1 tempest-VolumesSnapshotsTestJSON-1156270413 tempest-VolumesSnapshotsTestJSON-1156270413-project] Calling method '.version_select at 0x7f503ca39a60>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:56:44.088587 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-f2669f7c-1ee3-4a01-9619-420e750ed9a1 tempest-VolumesSnapshotsTestJSON-1156270413 tempest-VolumesSnapshotsTestJSON-1156270413-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/2089f72f-f550-4dda-b416-6b3b92589653" status: 200 len: 287 microversion: 2.1 time: 0.075451 Jun 03 09:56:44.092846 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 6/6] 10.222.0.45 () {58 vars in 1250 bytes} [Fri Jun 3 09:56:44 2022] GET /compute/v2.1/os-snapshots/2089f72f-f550-4dda-b416-6b3b92589653 => generated 287 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:56:45.101303 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-54889e47-ea35-4b62-8081-fa6457e78e24 tempest-VolumesSnapshotsTestJSON-1156270413 tempest-VolumesSnapshotsTestJSON-1156270413-project] Calling method '.version_select at 0x7f503ca391f0>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:56:45.253779 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-54889e47-ea35-4b62-8081-fa6457e78e24 tempest-VolumesSnapshotsTestJSON-1156270413 tempest-VolumesSnapshotsTestJSON-1156270413-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/2089f72f-f550-4dda-b416-6b3b92589653" status: 200 len: 287 microversion: 2.1 time: 0.156273 Jun 03 09:56:45.254603 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 7/7] 10.222.0.45 () {58 vars in 1250 bytes} [Fri Jun 3 09:56:45 2022] GET /compute/v2.1/os-snapshots/2089f72f-f550-4dda-b416-6b3b92589653 => generated 287 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:56:45.447226 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-04d2dad2-123e-4d6e-9b68-5f2f9c085c1d tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Flavor limits 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 09:56:45.447692 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-04d2dad2-123e-4d6e-9b68-5f2f9c085c1d tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Image limits 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 09:56:45.447835 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-04d2dad2-123e-4d6e-9b68-5f2f9c085c1d tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Flavor pref 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 09:56:45.448254 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-04d2dad2-123e-4d6e-9b68-5f2f9c085c1d tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Image pref 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 09:56:45.448676 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-04d2dad2-123e-4d6e-9b68-5f2f9c085c1d tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 09:56:45.488754 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-04d2dad2-123e-4d6e-9b68-5f2f9c085c1d tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:56:45.489260 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-04d2dad2-123e-4d6e-9b68-5f2f9c085c1d tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:56:45.490202 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-04d2dad2-123e-4d6e-9b68-5f2f9c085c1d tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:56:45.490643 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-04d2dad2-123e-4d6e-9b68-5f2f9c085c1d tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:56:45.588088 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-04d2dad2-123e-4d6e-9b68-5f2f9c085c1d tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Getting quotas for project ae18a142aa2049ffa07fc6516203f6fe. Resources: {'ram', 'cores', 'instances'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 09:56:45.641538 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-04d2dad2-123e-4d6e-9b68-5f2f9c085c1d tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Getting quotas for user c2e257ae4e744dd8a0553b7c2abee529 and project ae18a142aa2049ffa07fc6516203f6fe. Resources: {'ram', 'cores', 'instances'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 09:56:45.673914 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-04d2dad2-123e-4d6e-9b68-5f2f9c085c1d tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Going to run 1 instances... {{(pid=117647) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 09:56:45.683018 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-04d2dad2-123e-4d6e-9b68-5f2f9c085c1d tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] [instance: 85a66cd0-df20-4640-849b-73f7f01329b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0cb3b007-4e95-448b-8acb-895d8acdb244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 09:56:45.881093 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-04d2dad2-123e-4d6e-9b68-5f2f9c085c1d tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.902126 Jun 03 09:56:45.882154 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 1/8] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jun 3 09:56:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 4906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 03 09:56:45.893044 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-9c27fa92-b23d-4c4d-be87-b304ba6922d2 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:56:45.894097 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-9c27fa92-b23d-4c4d-be87-b304ba6922d2 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] [instance: 85a66cd0-df20-4640-849b-73f7f01329b9] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:56:46.204347 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-9c27fa92-b23d-4c4d-be87-b304ba6922d2 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e257ae4e744dd8a0553b7c2abee529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae18a142aa2049ffa07fc6516203f6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:56:46.233717 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-9c27fa92-b23d-4c4d-be87-b304ba6922d2 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] 10.222.0.45 "GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9" status: 200 len: 1215 microversion: 2.1 time: 0.343903 Jun 03 09:56:46.243254 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 8/9] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:56:45 2022] GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9 => generated 1215 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:56:46.266284 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-8c77e8d0-8603-4ac0-8599-1f7b1f558e7c tempest-VolumesSnapshotsTestJSON-1156270413 tempest-VolumesSnapshotsTestJSON-1156270413-project] Calling method '.version_select at 0x7f503c1da310>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:56:46.383220 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-8c77e8d0-8603-4ac0-8599-1f7b1f558e7c tempest-VolumesSnapshotsTestJSON-1156270413 tempest-VolumesSnapshotsTestJSON-1156270413-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/2089f72f-f550-4dda-b416-6b3b92589653" status: 200 len: 287 microversion: 2.1 time: 0.121345 Jun 03 09:56:46.383971 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 2/10] 10.222.0.45 () {58 vars in 1250 bytes} [Fri Jun 3 09:56:46 2022] GET /compute/v2.1/os-snapshots/2089f72f-f550-4dda-b416-6b3b92589653 => generated 287 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:56:47.261598 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-39c9000c-8975-4f2f-83c6-a2d6a71d3f27 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:56:47.263210 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-39c9000c-8975-4f2f-83c6-a2d6a71d3f27 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] [instance: 85a66cd0-df20-4640-849b-73f7f01329b9] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:56:47.397596 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-056b8329-323f-45ff-b8ec-a0374d4dd7f4 tempest-VolumesSnapshotsTestJSON-1156270413 tempest-VolumesSnapshotsTestJSON-1156270413-project] Calling method '.version_select at 0x7f503c13bc10>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:56:47.459491 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-056b8329-323f-45ff-b8ec-a0374d4dd7f4 tempest-VolumesSnapshotsTestJSON-1156270413 tempest-VolumesSnapshotsTestJSON-1156270413-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/2089f72f-f550-4dda-b416-6b3b92589653" status: 200 len: 287 microversion: 2.1 time: 0.067968 Jun 03 09:56:47.460465 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 3/11] 10.222.0.45 () {58 vars in 1250 bytes} [Fri Jun 3 09:56:47 2022] GET /compute/v2.1/os-snapshots/2089f72f-f550-4dda-b416-6b3b92589653 => generated 287 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:56:47.571951 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-39c9000c-8975-4f2f-83c6-a2d6a71d3f27 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e257ae4e744dd8a0553b7c2abee529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae18a142aa2049ffa07fc6516203f6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:56:47.584940 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-39c9000c-8975-4f2f-83c6-a2d6a71d3f27 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] 10.222.0.45 "GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9" status: 200 len: 1215 microversion: 2.1 time: 0.337998 Jun 03 09:56:47.587803 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 9/12] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:56:47 2022] GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9 => generated 1215 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:56:47.726579 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-8c557cec-707e-447f-9391-70934059c63b tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-789743084", "imageRef": "0cb3b007-4e95-448b-8acb-895d8acdb244", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:56:47.817371 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.network.neutron [None req-8c557cec-707e-447f-9391-70934059c63b tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] validate_networks() for [('b1ab1978-f76b-4220-bfdd-e128d8a1b1f5', None, None, None, None, None)] {{(pid=117647) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 09:56:48.472157 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-174a1a60-d4f7-4bce-853a-7d6944787f5f tempest-VolumesSnapshotsTestJSON-1156270413 tempest-VolumesSnapshotsTestJSON-1156270413-project] Calling method '.version_select at 0x7f503ca07820>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:56:48.555814 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-174a1a60-d4f7-4bce-853a-7d6944787f5f tempest-VolumesSnapshotsTestJSON-1156270413 tempest-VolumesSnapshotsTestJSON-1156270413-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/2089f72f-f550-4dda-b416-6b3b92589653" status: 200 len: 288 microversion: 2.1 time: 0.088204 Jun 03 09:56:48.556638 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 10/13] 10.222.0.45 () {58 vars in 1250 bytes} [Fri Jun 3 09:56:48 2022] GET /compute/v2.1/os-snapshots/2089f72f-f550-4dda-b416-6b3b92589653 => generated 288 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 09:56:48.568087 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-0cf7a849-7584-4a1b-8679-d2ec4882fa75 tempest-VolumesSnapshotsTestJSON-1156270413 tempest-VolumesSnapshotsTestJSON-1156270413-project] Calling method '.version_select at 0x7f503c9f6f70>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:56:48.689821 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-0cf7a849-7584-4a1b-8679-d2ec4882fa75 tempest-VolumesSnapshotsTestJSON-1156270413 tempest-VolumesSnapshotsTestJSON-1156270413-project] 10.222.0.45 "DELETE /compute/v2.1/os-snapshots/2089f72f-f550-4dda-b416-6b3b92589653" status: 202 len: 0 microversion: 2.1 time: 0.126505 Jun 03 09:56:48.693315 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 11/14] 10.222.0.45 () {58 vars in 1253 bytes} [Fri Jun 3 09:56:48 2022] DELETE /compute/v2.1/os-snapshots/2089f72f-f550-4dda-b416-6b3b92589653 => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 09:56:48.961628 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-adc92449-35c7-489c-b4b2-ef93c397ddb0 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Action: 'create', calling method: .version_select at 0x7f503ca9d280>, body: {"keypair": {"name": "tempest-keypair-2025725492", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOIcBHxa7j/H+EFW3+bdPP38uM3f++PTRoc98V32FCrQ2/3+2fGxatt9uzVbYd38UMEP0hNLQAprACt6uVey+fxe2+xwqPpe1tVkeClX3YSedu8AdciD+akwycRV9XW/DA=="}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:56:49.050749 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-adc92449-35c7-489c-b4b2-ef93c397ddb0 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Getting quotas for project a937f473cd1b44bc8d628c7cadb18856. Resources: {'key_pairs'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 09:56:49.081791 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-adc92449-35c7-489c-b4b2-ef93c397ddb0 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Getting quotas for user c216711b9e9b45f09f4917fe7b8275ab and project a937f473cd1b44bc8d628c7cadb18856. Resources: {'key_pairs'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 09:56:49.176360 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-8c557cec-707e-447f-9391-70934059c63b tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Flavor limits 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 09:56:49.176885 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-8c557cec-707e-447f-9391-70934059c63b tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Image limits 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 09:56:49.177265 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-8c557cec-707e-447f-9391-70934059c63b tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Flavor pref 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 09:56:49.179119 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-8c557cec-707e-447f-9391-70934059c63b tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Image pref 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 09:56:49.179562 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-8c557cec-707e-447f-9391-70934059c63b tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 09:56:49.196196 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8c557cec-707e-447f-9391-70934059c63b tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:56:49.196653 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8c557cec-707e-447f-9391-70934059c63b tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:56:49.211729 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8c557cec-707e-447f-9391-70934059c63b tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:56:49.212488 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8c557cec-707e-447f-9391-70934059c63b tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:56:49.212628 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-adc92449-35c7-489c-b4b2-ef93c397ddb0 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.520425 Jun 03 09:56:49.213469 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 12/15] 10.222.0.45 () {62 vars in 1199 bytes} [Fri Jun 3 09:56:48 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 522 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 03 09:56:49.222926 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-a8191135-1d40-443f-8d6d-d63bb173f2e8 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:56:49.222926 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-a8191135-1d40-443f-8d6d-d63bb173f2e8 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] [instance: 85a66cd0-df20-4640-849b-73f7f01329b9] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:56:49.257715 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a8191135-1d40-443f-8d6d-d63bb173f2e8 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:56:49.258227 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a8191135-1d40-443f-8d6d-d63bb173f2e8 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:56:49.259020 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a8191135-1d40-443f-8d6d-d63bb173f2e8 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:56:49.259463 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a8191135-1d40-443f-8d6d-d63bb173f2e8 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:56:49.319410 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-8c557cec-707e-447f-9391-70934059c63b tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Getting quotas for project b96e7e1b09a04adbba3bd083328ecb71. Resources: {'ram', 'cores', 'instances'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 09:56:49.330697 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-8c557cec-707e-447f-9391-70934059c63b tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Getting quotas for user d547e64bcf5d4799af6039df3c9a4ea6 and project b96e7e1b09a04adbba3bd083328ecb71. Resources: {'ram', 'cores', 'instances'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 09:56:49.366882 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-8c557cec-707e-447f-9391-70934059c63b tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Going to run 1 instances... {{(pid=117647) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 09:56:49.373343 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-8c557cec-707e-447f-9391-70934059c63b tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 59f3fa08-01f7-45d5-ae2b-171882dbc9c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0cb3b007-4e95-448b-8acb-895d8acdb244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 09:56:49.536044 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-8c557cec-707e-447f-9391-70934059c63b tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.987238 Jun 03 09:56:49.539545 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 4/16] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jun 3 09:56:47 2022] POST /compute/v2.1/servers => generated 383 bytes in 1991 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 09:56:49.554603 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-41eed4af-3289-4ea6-a6b2-65c3977a9e5c tempest-VolumesSnapshotsTestJSON-1156270413 tempest-VolumesSnapshotsTestJSON-1156270413-project] Calling method '.version_select at 0x7f503c14c670>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:56:49.626299 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.wsgi [None req-41eed4af-3289-4ea6-a6b2-65c3977a9e5c tempest-VolumesSnapshotsTestJSON-1156270413 tempest-VolumesSnapshotsTestJSON-1156270413-project] HTTP exception thrown: Snapshot 2089f72f-f550-4dda-b416-6b3b92589653 could not be found. Jun 03 09:56:49.630812 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-41eed4af-3289-4ea6-a6b2-65c3977a9e5c tempest-VolumesSnapshotsTestJSON-1156270413 tempest-VolumesSnapshotsTestJSON-1156270413-project] Request method failure captured: Jun 03 09:56:49.630812 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: request: GET /compute/v2.1/os-snapshots/2089f72f-f550-4dda-b416-6b3b92589653 HTTP/1.1 Jun 03 09:56:49.630812 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Accept: application/json Jun 03 09:56:49.630812 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Accept-Encoding: identity Jun 03 09:56:49.630812 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Connection: close Jun 03 09:56:49.630812 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Content-Length: 0 Jun 03 09:56:49.630812 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Content-Type: application/json Jun 03 09:56:49.630812 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Host: 10.222.0.45 Jun 03 09:56:49.630812 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Openstack-System-Scope: None Jun 03 09:56:49.630812 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: User-Agent: python-urllib3/1.26.9 Jun 03 09:56:49.630812 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Auth-Token: gAAAAABimdrVSaPDlvxKvVG6mNaXtKsNKmaESuCn9odXy_kg2YesUEwDtnHeLwPs3Zb7W6XWKpw1H_BLq-UWbBLGcydYUc7wHm4hyD0xz3PcAIZfJkDxMlbY38-PYLmTbu9yqD8qlxY2KWVSXClD3tSS2jLkwKKuNsZixzx6o4gkPDo9HHeTHt8 Jun 03 09:56:49.630812 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Domain-Id: None Jun 03 09:56:49.630812 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Domain-Name: None Jun 03 09:56:49.630812 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Identity-Status: Confirmed Jun 03 09:56:49.630812 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Is-Admin-Project: True Jun 03 09:56:49.630812 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Domain-Id: default Jun 03 09:56:49.630812 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Domain-Name: Default Jun 03 09:56:49.630812 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Id: 0113e961aabb493a979359ef3a0125fc Jun 03 09:56:49.630812 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1156270413 Jun 03 09:56:49.630812 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Role: member,reader Jun 03 09:56:49.630812 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Roles: member,reader Jun 03 09:56:49.631894 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0113e961aabb493a979359ef3a0125fc", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0113e961aabb493a979359ef3a0125fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0113e961aabb493a979359ef3a0125fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0113e961aabb493a979359ef3a0125fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 09:56:49.631894 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1156270413 Jun 03 09:56:49.631894 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant-Id: 0113e961aabb493a979359ef3a0125fc Jun 03 09:56:49.631894 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1156270413 Jun 03 09:56:49.631894 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User: tempest-VolumesSnapshotsTestJSON-1156270413-project Jun 03 09:56:49.631894 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Domain-Id: default Jun 03 09:56:49.631894 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Domain-Name: Default Jun 03 09:56:49.631894 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Id: 473e9dc191f841949aadc6a13b1290ae Jun 03 09:56:49.631894 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1156270413-project Jun 03 09:56:49.631894 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: method: Jun 03 09:56:49.631894 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: exception: Snapshot 2089f72f-f550-4dda-b416-6b3b92589653 could not be found. Jun 03 09:56:49.631894 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: action_args: {'id': '2089f72f-f550-4dda-b416-6b3b92589653'} Jun 03 09:56:49.631894 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:56:49.632508 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:56:49.632508 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 03 09:56:49.632508 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 03 09:56:49.632508 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 03 09:56:49.632508 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 03 09:56:49.632508 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 03 09:56:49.632508 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 03 09:56:49.632508 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 09:56:49.632508 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 09:56:49.632508 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 09:56:49.632508 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 09:56:49.632508 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 09:56:49.632508 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 09:56:49.632508 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 09:56:49.632508 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 09:56:49.632508 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 2089f72f-f550-4dda-b416-6b3b92589653 could not be found. (HTTP 404) (Request-ID: req-ef0f6566-4df1-4d05-b270-6d8b6f815ec6) Jun 03 09:56:49.632508 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 09:56:49.632508 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:56:49.633422 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 09:56:49.633422 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:56:49.633422 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 03 09:56:49.633422 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 03 09:56:49.633422 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 09:56:49.633422 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 09:56:49.633422 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 03 09:56:49.633422 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 03 09:56:49.633422 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 09:56:49.633422 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 09:56:49.633422 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 03 09:56:49.633422 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 03 09:56:49.633422 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 03 09:56:49.633422 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 03 09:56:49.633422 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 03 09:56:49.633422 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 03 09:56:49.633422 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 09:56:49.633422 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 09:56:49.633422 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 09:56:49.635231 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 09:56:49.635231 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 09:56:49.635231 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 09:56:49.635231 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 09:56:49.635231 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 09:56:49.635231 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 2089f72f-f550-4dda-b416-6b3b92589653 could not be found. Jun 03 09:56:49.635231 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 09:56:49.635231 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:56:49.635231 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 09:56:49.635231 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:56:49.635231 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:56:49.635231 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:56:49.635231 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:56:49.635231 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:56:49.635231 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 09:56:49.635231 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 09:56:49.635231 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:56:49.635231 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:56:49.635231 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 03 09:56:49.635231 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:56:49.636471 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 2089f72f-f550-4dda-b416-6b3b92589653 could not be found. Jun 03 09:56:49.636471 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 09:56:49.636471 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:56:49.636471 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 09:56:49.636471 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:56:49.636471 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:56:49.636471 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:56:49.636471 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:56:49.636471 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:56:49.636471 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 2089f72f-f550-4dda-b416-6b3b92589653 could not be found. Jun 03 09:56:49.636471 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 09:56:49.636471 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-41eed4af-3289-4ea6-a6b2-65c3977a9e5c tempest-VolumesSnapshotsTestJSON-1156270413 tempest-VolumesSnapshotsTestJSON-1156270413-project] Returning 404 to user: Snapshot 2089f72f-f550-4dda-b416-6b3b92589653 could not be found. {{(pid=117647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:56:49.636471 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-41eed4af-3289-4ea6-a6b2-65c3977a9e5c tempest-VolumesSnapshotsTestJSON-1156270413 tempest-VolumesSnapshotsTestJSON-1156270413-project] 10.222.0.45 "GET /compute/v2.1/os-snapshots/2089f72f-f550-4dda-b416-6b3b92589653" status: 404 len: 111 microversion: 2.1 time: 0.091329 Jun 03 09:56:49.638188 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 5/17] 10.222.0.45 () {58 vars in 1250 bytes} [Fri Jun 3 09:56:49 2022] GET /compute/v2.1/os-snapshots/2089f72f-f550-4dda-b416-6b3b92589653 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:56:49.654048 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-3399e4a5-5153-4355-a2c1-b5b0a8508aee tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:56:49.658117 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-3399e4a5-5153-4355-a2c1-b5b0a8508aee tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 59f3fa08-01f7-45d5-ae2b-171882dbc9c5] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:56:49.841692 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-a8191135-1d40-443f-8d6d-d63bb173f2e8 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e257ae4e744dd8a0553b7c2abee529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae18a142aa2049ffa07fc6516203f6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:56:49.857507 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-3399e4a5-5153-4355-a2c1-b5b0a8508aee tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:56:49.887142 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-a8191135-1d40-443f-8d6d-d63bb173f2e8 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] 10.222.0.45 "GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9" status: 200 len: 1267 microversion: 2.1 time: 0.672521 Jun 03 09:56:49.899503 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 13/18] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:56:49 2022] GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9 => generated 1267 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:56:49.903058 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-3399e4a5-5153-4355-a2c1-b5b0a8508aee tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5" status: 200 len: 1221 microversion: 2.1 time: 0.266059 Jun 03 09:56:49.908004 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-47e3ae64-7c0c-41e7-85c0-88e5acfdecd9 tempest-VolumesSnapshotsTestJSON-1156270413 tempest-VolumesSnapshotsTestJSON-1156270413-project] Calling method '.version_select at 0x7f503c111a60>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:56:49.908809 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 6/19] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:56:49 2022] GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5 => generated 1221 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:56:50.079640 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-47e3ae64-7c0c-41e7-85c0-88e5acfdecd9 tempest-VolumesSnapshotsTestJSON-1156270413 tempest-VolumesSnapshotsTestJSON-1156270413-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/e724a7ac-6594-4041-84d9-409b034c4dc0" status: 202 len: 0 microversion: 2.1 time: 0.177613 Jun 03 09:56:50.080764 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 14/20] 10.222.0.45 () {58 vars in 1247 bytes} [Fri Jun 3 09:56:49 2022] DELETE /compute/v2.1/os-volumes/e724a7ac-6594-4041-84d9-409b034c4dc0 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 09:56:50.089052 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-d46d9903-a713-44a7-bf4e-275904eda742 tempest-VolumesSnapshotsTestJSON-1156270413 tempest-VolumesSnapshotsTestJSON-1156270413-project] Calling method '.version_select at 0x7f503c0b4790>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:56:50.207161 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-d46d9903-a713-44a7-bf4e-275904eda742 tempest-VolumesSnapshotsTestJSON-1156270413 tempest-VolumesSnapshotsTestJSON-1156270413-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/e724a7ac-6594-4041-84d9-409b034c4dc0" status: 200 len: 345 microversion: 2.1 time: 0.122243 Jun 03 09:56:50.212666 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 7/21] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Jun 3 09:56:50 2022] GET /compute/v2.1/os-volumes/e724a7ac-6594-4041-84d9-409b034c4dc0 => generated 345 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:56:50.230814 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-8d104fb1-b864-4f83-813d-cb2df5e446b5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1309878440", "imageRef": "0cb3b007-4e95-448b-8acb-895d8acdb244", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:56:50.479914 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.network.neutron [None req-8d104fb1-b864-4f83-813d-cb2df5e446b5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] validate_networks() for [('b1ab1978-f76b-4220-bfdd-e128d8a1b1f5', None, None, None, None, None)] {{(pid=117648) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 09:56:50.905785 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-1c96705d-4efe-499b-b710-8b47db98da12 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:56:50.905785 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-1c96705d-4efe-499b-b710-8b47db98da12 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] [instance: 85a66cd0-df20-4640-849b-73f7f01329b9] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:56:50.917965 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1c96705d-4efe-499b-b710-8b47db98da12 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:56:50.918428 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1c96705d-4efe-499b-b710-8b47db98da12 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:56:50.919219 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1c96705d-4efe-499b-b710-8b47db98da12 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:56:50.919660 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1c96705d-4efe-499b-b710-8b47db98da12 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:56:51.609119 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-1c96705d-4efe-499b-b710-8b47db98da12 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e257ae4e744dd8a0553b7c2abee529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae18a142aa2049ffa07fc6516203f6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:56:51.631863 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-1c96705d-4efe-499b-b710-8b47db98da12 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] 10.222.0.45 "GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9" status: 200 len: 1273 microversion: 2.1 time: 0.731396 Jun 03 09:56:51.634235 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 8/22] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:56:50 2022] GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9 => generated 1273 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:56:51.650236 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-b1a8332f-f2ce-47c4-8971-23942a7cd436 tempest-VolumesSnapshotsTestJSON-1156270413 tempest-VolumesSnapshotsTestJSON-1156270413-project] Calling method '.version_select at 0x7f503c04fca0>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:56:51.767324 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-b1a8332f-f2ce-47c4-8971-23942a7cd436 tempest-VolumesSnapshotsTestJSON-1156270413 tempest-VolumesSnapshotsTestJSON-1156270413-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/e724a7ac-6594-4041-84d9-409b034c4dc0" status: 200 len: 345 microversion: 2.1 time: 0.131450 Jun 03 09:56:51.768826 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 9/23] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Jun 3 09:56:51 2022] GET /compute/v2.1/os-volumes/e724a7ac-6594-4041-84d9-409b034c4dc0 => generated 345 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:56:52.533291 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-8d104fb1-b864-4f83-813d-cb2df5e446b5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Flavor limits 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 09:56:52.534712 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-8d104fb1-b864-4f83-813d-cb2df5e446b5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Image limits 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 09:56:52.535216 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-8d104fb1-b864-4f83-813d-cb2df5e446b5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Flavor pref 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 09:56:52.547645 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-8d104fb1-b864-4f83-813d-cb2df5e446b5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Image pref 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 09:56:52.549043 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-8d104fb1-b864-4f83-813d-cb2df5e446b5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 09:56:52.600532 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8d104fb1-b864-4f83-813d-cb2df5e446b5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:56:52.601024 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8d104fb1-b864-4f83-813d-cb2df5e446b5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:56:52.601940 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8d104fb1-b864-4f83-813d-cb2df5e446b5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:56:52.602389 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8d104fb1-b864-4f83-813d-cb2df5e446b5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:56:52.651016 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-35780cd0-1bc2-4109-8bce-d0413d62d475 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:56:52.652661 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-35780cd0-1bc2-4109-8bce-d0413d62d475 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] [instance: 85a66cd0-df20-4640-849b-73f7f01329b9] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:56:52.670552 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-35780cd0-1bc2-4109-8bce-d0413d62d475 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:56:52.671284 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-35780cd0-1bc2-4109-8bce-d0413d62d475 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:56:52.675072 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-8d104fb1-b864-4f83-813d-cb2df5e446b5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Getting quotas for project b96e7e1b09a04adbba3bd083328ecb71. Resources: {'ram', 'cores', 'instances'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 09:56:52.675514 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-35780cd0-1bc2-4109-8bce-d0413d62d475 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:56:52.677304 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-35780cd0-1bc2-4109-8bce-d0413d62d475 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:56:52.691445 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-8d104fb1-b864-4f83-813d-cb2df5e446b5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Getting quotas for user d547e64bcf5d4799af6039df3c9a4ea6 and project b96e7e1b09a04adbba3bd083328ecb71. Resources: {'ram', 'cores', 'instances'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 09:56:52.709563 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-8d104fb1-b864-4f83-813d-cb2df5e446b5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Going to run 1 instances... {{(pid=117648) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 09:56:52.736500 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-8d104fb1-b864-4f83-813d-cb2df5e446b5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0cb3b007-4e95-448b-8acb-895d8acdb244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 09:56:52.892296 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-8d104fb1-b864-4f83-813d-cb2df5e446b5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.667269 Jun 03 09:56:52.893581 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 15/24] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jun 3 09:56:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 2670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 09:56:52.899437 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-915d551d-fa03-4294-b5e2-744786ae20b6 tempest-VolumesSnapshotsTestJSON-1156270413 tempest-VolumesSnapshotsTestJSON-1156270413-project] Calling method '.version_select at 0x7f503c05d1f0>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:56:52.972985 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-915d551d-fa03-4294-b5e2-744786ae20b6 tempest-VolumesSnapshotsTestJSON-1156270413 tempest-VolumesSnapshotsTestJSON-1156270413-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/e724a7ac-6594-4041-84d9-409b034c4dc0" status: 200 len: 345 microversion: 2.1 time: 0.077837 Jun 03 09:56:52.974484 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 16/25] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Jun 3 09:56:52 2022] GET /compute/v2.1/os-volumes/e724a7ac-6594-4041-84d9-409b034c4dc0 => generated 345 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:56:52.980454 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-3862c874-a899-439b-ab58-6355a07a42f1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:56:52.981347 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-3862c874-a899-439b-ab58-6355a07a42f1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:56:53.203181 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-35780cd0-1bc2-4109-8bce-d0413d62d475 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e257ae4e744dd8a0553b7c2abee529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae18a142aa2049ffa07fc6516203f6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:56:53.215857 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-35780cd0-1bc2-4109-8bce-d0413d62d475 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] 10.222.0.45 "GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9" status: 200 len: 1273 microversion: 2.1 time: 0.568398 Jun 03 09:56:53.226093 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 10/26] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:56:52 2022] GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9 => generated 1273 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:56:53.285445 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-3862c874-a899-439b-ab58-6355a07a42f1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:56:53.309869 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-3862c874-a899-439b-ab58-6355a07a42f1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1222 microversion: 2.1 time: 0.333714 Jun 03 09:56:53.310566 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 17/27] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:56:52 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1222 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:56:53.991401 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-64acfe9a-d3d5-4251-85a8-bc09a0940178 tempest-VolumesSnapshotsTestJSON-1156270413 tempest-VolumesSnapshotsTestJSON-1156270413-project] Calling method '.version_select at 0x7f50377c3dc0>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:56:54.083423 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.wsgi [None req-64acfe9a-d3d5-4251-85a8-bc09a0940178 tempest-VolumesSnapshotsTestJSON-1156270413 tempest-VolumesSnapshotsTestJSON-1156270413-project] HTTP exception thrown: Volume e724a7ac-6594-4041-84d9-409b034c4dc0 could not be found. Jun 03 09:56:54.090039 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-64acfe9a-d3d5-4251-85a8-bc09a0940178 tempest-VolumesSnapshotsTestJSON-1156270413 tempest-VolumesSnapshotsTestJSON-1156270413-project] Request method failure captured: Jun 03 09:56:54.090039 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: request: GET /compute/v2.1/os-volumes/e724a7ac-6594-4041-84d9-409b034c4dc0 HTTP/1.1 Jun 03 09:56:54.090039 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Accept: application/json Jun 03 09:56:54.090039 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Accept-Encoding: identity Jun 03 09:56:54.090039 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Connection: close Jun 03 09:56:54.090039 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Content-Length: 0 Jun 03 09:56:54.090039 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Content-Type: application/json Jun 03 09:56:54.090039 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Host: 10.222.0.45 Jun 03 09:56:54.090039 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Openstack-System-Scope: None Jun 03 09:56:54.090039 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: User-Agent: python-urllib3/1.26.9 Jun 03 09:56:54.090039 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Auth-Token: gAAAAABimdrVSaPDlvxKvVG6mNaXtKsNKmaESuCn9odXy_kg2YesUEwDtnHeLwPs3Zb7W6XWKpw1H_BLq-UWbBLGcydYUc7wHm4hyD0xz3PcAIZfJkDxMlbY38-PYLmTbu9yqD8qlxY2KWVSXClD3tSS2jLkwKKuNsZixzx6o4gkPDo9HHeTHt8 Jun 03 09:56:54.090039 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Domain-Id: None Jun 03 09:56:54.090039 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Domain-Name: None Jun 03 09:56:54.090039 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Identity-Status: Confirmed Jun 03 09:56:54.090039 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Is-Admin-Project: True Jun 03 09:56:54.090039 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Domain-Id: default Jun 03 09:56:54.090039 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Domain-Name: Default Jun 03 09:56:54.090039 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Id: 0113e961aabb493a979359ef3a0125fc Jun 03 09:56:54.090039 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1156270413 Jun 03 09:56:54.090039 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Role: member,reader Jun 03 09:56:54.090039 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Roles: member,reader Jun 03 09:56:54.091067 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0113e961aabb493a979359ef3a0125fc", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0113e961aabb493a979359ef3a0125fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0113e961aabb493a979359ef3a0125fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0113e961aabb493a979359ef3a0125fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 09:56:54.091067 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1156270413 Jun 03 09:56:54.091067 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant-Id: 0113e961aabb493a979359ef3a0125fc Jun 03 09:56:54.091067 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1156270413 Jun 03 09:56:54.091067 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User: tempest-VolumesSnapshotsTestJSON-1156270413-project Jun 03 09:56:54.091067 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Domain-Id: default Jun 03 09:56:54.091067 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Domain-Name: Default Jun 03 09:56:54.091067 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Id: 473e9dc191f841949aadc6a13b1290ae Jun 03 09:56:54.091067 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1156270413-project Jun 03 09:56:54.091067 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: method: Jun 03 09:56:54.091067 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: exception: Volume e724a7ac-6594-4041-84d9-409b034c4dc0 could not be found. Jun 03 09:56:54.091067 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: action_args: {'id': 'e724a7ac-6594-4041-84d9-409b034c4dc0'} Jun 03 09:56:54.091067 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:56:54.091786 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:56:54.091786 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 09:56:54.091786 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 09:56:54.091786 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 09:56:54.091786 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 09:56:54.091786 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 09:56:54.091786 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 09:56:54.091786 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 09:56:54.091786 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 09:56:54.091786 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 09:56:54.091786 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 09:56:54.091786 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 09:56:54.091786 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 09:56:54.091786 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 09:56:54.091786 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 09:56:54.091786 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e724a7ac-6594-4041-84d9-409b034c4dc0 could not be found. (HTTP 404) (Request-ID: req-8c6190b5-6259-44b3-8a77-01c85f291db1) Jun 03 09:56:54.091786 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 09:56:54.091786 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:56:54.091786 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 09:56:54.092745 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:56:54.092745 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 03 09:56:54.092745 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 03 09:56:54.092745 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 09:56:54.092745 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 09:56:54.092745 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 03 09:56:54.092745 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 03 09:56:54.092745 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 09:56:54.092745 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 09:56:54.092745 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 09:56:54.092745 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 09:56:54.092745 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 09:56:54.092745 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 09:56:54.092745 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 09:56:54.092745 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 09:56:54.092745 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 09:56:54.092745 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 09:56:54.092745 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 09:56:54.092745 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 09:56:54.094006 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 09:56:54.094006 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 09:56:54.094006 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 09:56:54.094006 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 09:56:54.094006 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e724a7ac-6594-4041-84d9-409b034c4dc0 could not be found. Jun 03 09:56:54.094006 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 09:56:54.094006 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:56:54.094006 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 09:56:54.094006 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:56:54.094006 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:56:54.094006 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:56:54.094006 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:56:54.094006 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:56:54.094006 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 09:56:54.094006 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 09:56:54.094006 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:56:54.094006 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:56:54.094006 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 03 09:56:54.094006 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:56:54.095528 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e724a7ac-6594-4041-84d9-409b034c4dc0 could not be found. Jun 03 09:56:54.095528 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 09:56:54.095528 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:56:54.095528 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 09:56:54.095528 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:56:54.095528 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:56:54.095528 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:56:54.095528 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:56:54.095528 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:56:54.095528 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e724a7ac-6594-4041-84d9-409b034c4dc0 could not be found. Jun 03 09:56:54.095528 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 09:56:54.095528 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-64acfe9a-d3d5-4251-85a8-bc09a0940178 tempest-VolumesSnapshotsTestJSON-1156270413 tempest-VolumesSnapshotsTestJSON-1156270413-project] Returning 404 to user: Volume e724a7ac-6594-4041-84d9-409b034c4dc0 could not be found. {{(pid=117647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:56:54.097800 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-64acfe9a-d3d5-4251-85a8-bc09a0940178 tempest-VolumesSnapshotsTestJSON-1156270413 tempest-VolumesSnapshotsTestJSON-1156270413-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/e724a7ac-6594-4041-84d9-409b034c4dc0" status: 404 len: 109 microversion: 2.1 time: 0.108506 Jun 03 09:56:54.101127 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 11/28] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Jun 3 09:56:53 2022] GET /compute/v2.1/os-volumes/e724a7ac-6594-4041-84d9-409b034c4dc0 => generated 109 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:56:54.115563 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-1180e772-8319-48ae-9362-9c92f7d202c8 tempest-VolumesSnapshotsTestJSON-1156270413 tempest-VolumesSnapshotsTestJSON-1156270413-project] Calling method '.version_select at 0x7f503c05dca0>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:56:54.233050 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-774adb57-23db-401e-96d6-419a617d8aaa tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:56:54.234031 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-774adb57-23db-401e-96d6-419a617d8aaa tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] [instance: 85a66cd0-df20-4640-849b-73f7f01329b9] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:56:54.262387 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-774adb57-23db-401e-96d6-419a617d8aaa tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:56:54.269254 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-774adb57-23db-401e-96d6-419a617d8aaa tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:56:54.271659 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-774adb57-23db-401e-96d6-419a617d8aaa tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:56:54.276954 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-774adb57-23db-401e-96d6-419a617d8aaa tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:56:54.284415 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.wsgi [None req-1180e772-8319-48ae-9362-9c92f7d202c8 tempest-VolumesSnapshotsTestJSON-1156270413 tempest-VolumesSnapshotsTestJSON-1156270413-project] HTTP exception thrown: Volume e724a7ac-6594-4041-84d9-409b034c4dc0 could not be found. Jun 03 09:56:54.289547 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-1180e772-8319-48ae-9362-9c92f7d202c8 tempest-VolumesSnapshotsTestJSON-1156270413 tempest-VolumesSnapshotsTestJSON-1156270413-project] Request method failure captured: Jun 03 09:56:54.289547 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: request: DELETE /compute/v2.1/os-volumes/e724a7ac-6594-4041-84d9-409b034c4dc0 HTTP/1.1 Jun 03 09:56:54.289547 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept: application/json Jun 03 09:56:54.289547 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept-Encoding: identity Jun 03 09:56:54.289547 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Connection: close Jun 03 09:56:54.289547 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Length: 0 Jun 03 09:56:54.289547 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Type: application/json Jun 03 09:56:54.289547 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Host: 10.222.0.45 Jun 03 09:56:54.289547 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Openstack-System-Scope: None Jun 03 09:56:54.289547 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: User-Agent: python-urllib3/1.26.9 Jun 03 09:56:54.289547 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Auth-Token: gAAAAABimdrVSaPDlvxKvVG6mNaXtKsNKmaESuCn9odXy_kg2YesUEwDtnHeLwPs3Zb7W6XWKpw1H_BLq-UWbBLGcydYUc7wHm4hyD0xz3PcAIZfJkDxMlbY38-PYLmTbu9yqD8qlxY2KWVSXClD3tSS2jLkwKKuNsZixzx6o4gkPDo9HHeTHt8 Jun 03 09:56:54.289547 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Id: None Jun 03 09:56:54.289547 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Name: None Jun 03 09:56:54.289547 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Identity-Status: Confirmed Jun 03 09:56:54.289547 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Is-Admin-Project: True Jun 03 09:56:54.289547 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Id: default Jun 03 09:56:54.289547 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Name: Default Jun 03 09:56:54.289547 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Id: 0113e961aabb493a979359ef3a0125fc Jun 03 09:56:54.289547 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1156270413 Jun 03 09:56:54.289547 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Role: member,reader Jun 03 09:56:54.289547 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Roles: member,reader Jun 03 09:56:54.291009 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0113e961aabb493a979359ef3a0125fc", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0113e961aabb493a979359ef3a0125fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0113e961aabb493a979359ef3a0125fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0113e961aabb493a979359ef3a0125fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 09:56:54.291009 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1156270413 Jun 03 09:56:54.291009 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Id: 0113e961aabb493a979359ef3a0125fc Jun 03 09:56:54.291009 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1156270413 Jun 03 09:56:54.291009 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User: tempest-VolumesSnapshotsTestJSON-1156270413-project Jun 03 09:56:54.291009 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Id: default Jun 03 09:56:54.291009 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Name: Default Jun 03 09:56:54.291009 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Id: 473e9dc191f841949aadc6a13b1290ae Jun 03 09:56:54.291009 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1156270413-project Jun 03 09:56:54.291009 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: method: Jun 03 09:56:54.291009 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: exception: Volume e724a7ac-6594-4041-84d9-409b034c4dc0 could not be found. Jun 03 09:56:54.291009 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: action_args: {'id': 'e724a7ac-6594-4041-84d9-409b034c4dc0'} Jun 03 09:56:54.291009 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:56:54.291883 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:56:54.291883 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 09:56:54.291883 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 09:56:54.291883 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 03 09:56:54.291883 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 03 09:56:54.291883 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 03 09:56:54.291883 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 03 09:56:54.291883 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 03 09:56:54.291883 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 03 09:56:54.291883 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 03 09:56:54.291883 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 03 09:56:54.291883 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 09:56:54.291883 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 09:56:54.291883 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 09:56:54.291883 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 09:56:54.291883 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e724a7ac-6594-4041-84d9-409b034c4dc0 could not be found. (HTTP 404) (Request-ID: req-ee75a1c0-5534-45d6-b51b-ff2937da4e92) Jun 03 09:56:54.291883 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 09:56:54.291883 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:56:54.291883 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 09:56:54.293031 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:56:54.293031 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 03 09:56:54.293031 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 03 09:56:54.293031 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 09:56:54.293031 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 09:56:54.293031 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 03 09:56:54.293031 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 03 09:56:54.293031 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 09:56:54.293031 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 09:56:54.293031 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 09:56:54.293031 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 09:56:54.293031 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 03 09:56:54.293031 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 03 09:56:54.293031 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 03 09:56:54.293031 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 03 09:56:54.293031 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 03 09:56:54.293031 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 03 09:56:54.293031 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 03 09:56:54.293031 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 03 09:56:54.294177 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 09:56:54.294177 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 09:56:54.294177 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 09:56:54.294177 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 09:56:54.294177 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e724a7ac-6594-4041-84d9-409b034c4dc0 could not be found. Jun 03 09:56:54.294177 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 09:56:54.294177 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:56:54.294177 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 09:56:54.294177 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:56:54.294177 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:56:54.294177 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:56:54.294177 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:56:54.294177 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:56:54.294177 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 09:56:54.294177 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 09:56:54.294177 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:56:54.294177 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:56:54.294177 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 03 09:56:54.294177 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:56:54.295327 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e724a7ac-6594-4041-84d9-409b034c4dc0 could not be found. Jun 03 09:56:54.295327 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 09:56:54.295327 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:56:54.295327 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 09:56:54.295327 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:56:54.295327 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:56:54.295327 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:56:54.295327 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:56:54.295327 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:56:54.295327 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e724a7ac-6594-4041-84d9-409b034c4dc0 could not be found. Jun 03 09:56:54.295327 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 09:56:54.298731 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-1180e772-8319-48ae-9362-9c92f7d202c8 tempest-VolumesSnapshotsTestJSON-1156270413 tempest-VolumesSnapshotsTestJSON-1156270413-project] Returning 404 to user: Volume e724a7ac-6594-4041-84d9-409b034c4dc0 could not be found. {{(pid=117648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:56:54.300835 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-1180e772-8319-48ae-9362-9c92f7d202c8 tempest-VolumesSnapshotsTestJSON-1156270413 tempest-VolumesSnapshotsTestJSON-1156270413-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/e724a7ac-6594-4041-84d9-409b034c4dc0" status: 404 len: 109 microversion: 2.1 time: 0.189322 Jun 03 09:56:54.301591 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 18/29] 10.222.0.45 () {58 vars in 1247 bytes} [Fri Jun 3 09:56:54 2022] DELETE /compute/v2.1/os-volumes/e724a7ac-6594-4041-84d9-409b034c4dc0 => generated 109 bytes in 192 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:56:54.312771 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-dc7f05d8-ee50-4061-8334-73ad58bbdc39 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1105257268", "imageRef": "0cb3b007-4e95-448b-8acb-895d8acdb244", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "49acf399-babc-4227-8840-e015148cac86"}], "security_groups": [{"name": "tempest-securitygroup--469701417"}], "key_name": "tempest-keypair-2025725492", "user_data": "}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:56:54.704770 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-774adb57-23db-401e-96d6-419a617d8aaa tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e257ae4e744dd8a0553b7c2abee529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae18a142aa2049ffa07fc6516203f6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:56:54.721708 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-774adb57-23db-401e-96d6-419a617d8aaa tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] 10.222.0.45 "GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9" status: 200 len: 1273 microversion: 2.1 time: 0.489168 Jun 03 09:56:54.725518 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 12/30] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:56:54 2022] GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9 => generated 1273 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:56:54.746419 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-7522b529-bcc0-4e11-b02f-b900cf891d1f tempest-VolumesSnapshotsTestJSON-1156270413 tempest-VolumesSnapshotsTestJSON-1156270413-project] Calling method '.version_select at 0x7f503c066ee0>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:56:54.942837 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.wsgi [None req-7522b529-bcc0-4e11-b02f-b900cf891d1f tempest-VolumesSnapshotsTestJSON-1156270413 tempest-VolumesSnapshotsTestJSON-1156270413-project] HTTP exception thrown: Volume e724a7ac-6594-4041-84d9-409b034c4dc0 could not be found. Jun 03 09:56:54.944998 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-7522b529-bcc0-4e11-b02f-b900cf891d1f tempest-VolumesSnapshotsTestJSON-1156270413 tempest-VolumesSnapshotsTestJSON-1156270413-project] Request method failure captured: Jun 03 09:56:54.944998 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: request: GET /compute/v2.1/os-volumes/e724a7ac-6594-4041-84d9-409b034c4dc0 HTTP/1.1 Jun 03 09:56:54.944998 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Accept: application/json Jun 03 09:56:54.944998 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Accept-Encoding: identity Jun 03 09:56:54.944998 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Connection: close Jun 03 09:56:54.944998 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Content-Length: 0 Jun 03 09:56:54.944998 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Content-Type: application/json Jun 03 09:56:54.944998 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Host: 10.222.0.45 Jun 03 09:56:54.944998 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Openstack-System-Scope: None Jun 03 09:56:54.944998 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: User-Agent: python-urllib3/1.26.9 Jun 03 09:56:54.944998 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Auth-Token: gAAAAABimdrVSaPDlvxKvVG6mNaXtKsNKmaESuCn9odXy_kg2YesUEwDtnHeLwPs3Zb7W6XWKpw1H_BLq-UWbBLGcydYUc7wHm4hyD0xz3PcAIZfJkDxMlbY38-PYLmTbu9yqD8qlxY2KWVSXClD3tSS2jLkwKKuNsZixzx6o4gkPDo9HHeTHt8 Jun 03 09:56:54.944998 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Domain-Id: None Jun 03 09:56:54.944998 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Domain-Name: None Jun 03 09:56:54.944998 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Identity-Status: Confirmed Jun 03 09:56:54.944998 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Is-Admin-Project: True Jun 03 09:56:54.944998 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Domain-Id: default Jun 03 09:56:54.944998 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Domain-Name: Default Jun 03 09:56:54.944998 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Id: 0113e961aabb493a979359ef3a0125fc Jun 03 09:56:54.944998 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1156270413 Jun 03 09:56:54.944998 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Role: member,reader Jun 03 09:56:54.944998 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Roles: member,reader Jun 03 09:56:54.946354 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0113e961aabb493a979359ef3a0125fc", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0113e961aabb493a979359ef3a0125fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0113e961aabb493a979359ef3a0125fc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0113e961aabb493a979359ef3a0125fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 09:56:54.946354 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1156270413 Jun 03 09:56:54.946354 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant-Id: 0113e961aabb493a979359ef3a0125fc Jun 03 09:56:54.946354 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1156270413 Jun 03 09:56:54.946354 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User: tempest-VolumesSnapshotsTestJSON-1156270413-project Jun 03 09:56:54.946354 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Domain-Id: default Jun 03 09:56:54.946354 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Domain-Name: Default Jun 03 09:56:54.946354 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Id: 473e9dc191f841949aadc6a13b1290ae Jun 03 09:56:54.946354 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1156270413-project Jun 03 09:56:54.946354 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: method: Jun 03 09:56:54.946354 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: exception: Volume e724a7ac-6594-4041-84d9-409b034c4dc0 could not be found. Jun 03 09:56:54.946354 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: action_args: {'id': 'e724a7ac-6594-4041-84d9-409b034c4dc0'} Jun 03 09:56:54.946354 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:56:54.947282 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:56:54.947282 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 09:56:54.947282 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 09:56:54.947282 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 09:56:54.947282 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 09:56:54.947282 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 09:56:54.947282 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 09:56:54.947282 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 09:56:54.947282 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 09:56:54.947282 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 09:56:54.947282 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 09:56:54.947282 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 09:56:54.947282 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 09:56:54.947282 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 09:56:54.947282 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 09:56:54.947282 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e724a7ac-6594-4041-84d9-409b034c4dc0 could not be found. (HTTP 404) (Request-ID: req-0ccf095e-07b2-4c82-98db-09f0e24016cd) Jun 03 09:56:54.947282 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 09:56:54.947282 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:56:54.947282 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 09:56:54.948353 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:56:54.948353 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 03 09:56:54.948353 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 03 09:56:54.948353 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 09:56:54.948353 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 09:56:54.948353 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 03 09:56:54.948353 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 03 09:56:54.948353 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 09:56:54.948353 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 09:56:54.948353 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 09:56:54.948353 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 09:56:54.948353 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 09:56:54.948353 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 09:56:54.948353 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 09:56:54.948353 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 09:56:54.948353 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 09:56:54.948353 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 09:56:54.948353 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 09:56:54.948353 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 09:56:54.949444 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 09:56:54.949444 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 09:56:54.949444 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 09:56:54.949444 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 09:56:54.949444 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e724a7ac-6594-4041-84d9-409b034c4dc0 could not be found. Jun 03 09:56:54.949444 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 09:56:54.949444 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:56:54.949444 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 09:56:54.949444 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:56:54.949444 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:56:54.949444 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:56:54.949444 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:56:54.949444 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:56:54.949444 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 09:56:54.949444 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 09:56:54.949444 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:56:54.949444 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:56:54.949444 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 03 09:56:54.949444 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:56:54.950485 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e724a7ac-6594-4041-84d9-409b034c4dc0 could not be found. Jun 03 09:56:54.950485 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 09:56:54.950485 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:56:54.950485 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 09:56:54.950485 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:56:54.950485 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:56:54.950485 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:56:54.950485 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:56:54.950485 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:56:54.950485 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e724a7ac-6594-4041-84d9-409b034c4dc0 could not be found. Jun 03 09:56:54.950485 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 09:56:54.950485 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-7522b529-bcc0-4e11-b02f-b900cf891d1f tempest-VolumesSnapshotsTestJSON-1156270413 tempest-VolumesSnapshotsTestJSON-1156270413-project] Returning 404 to user: Volume e724a7ac-6594-4041-84d9-409b034c4dc0 could not be found. {{(pid=117647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:56:54.950485 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-7522b529-bcc0-4e11-b02f-b900cf891d1f tempest-VolumesSnapshotsTestJSON-1156270413 tempest-VolumesSnapshotsTestJSON-1156270413-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/e724a7ac-6594-4041-84d9-409b034c4dc0" status: 404 len: 109 microversion: 2.1 time: 0.215681 Jun 03 09:56:54.950485 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 13/31] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Jun 3 09:56:54 2022] GET /compute/v2.1/os-volumes/e724a7ac-6594-4041-84d9-409b034c4dc0 => generated 109 bytes in 222 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:56:54.955542 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-0956668d-64d9-4cad-b000-299fa5662635 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:56:54.957865 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-0956668d-64d9-4cad-b000-299fa5662635 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:56:54.980168 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0956668d-64d9-4cad-b000-299fa5662635 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:56:54.980733 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0956668d-64d9-4cad-b000-299fa5662635 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:56:54.981973 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0956668d-64d9-4cad-b000-299fa5662635 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:56:54.988530 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0956668d-64d9-4cad-b000-299fa5662635 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:56:55.116983 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.network.neutron [None req-dc7f05d8-ee50-4061-8334-73ad58bbdc39 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] validate_networks() for [('49acf399-babc-4227-8840-e015148cac86', None, None, None, None, None)] {{(pid=117648) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 09:56:55.734449 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-0956668d-64d9-4cad-b000-299fa5662635 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:56:55.746101 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-0956668d-64d9-4cad-b000-299fa5662635 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1274 microversion: 2.1 time: 0.796753 Jun 03 09:56:55.752745 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 14/32] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:56:54 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1274 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:56:56.281444 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-65274bc2-7f92-4752-8869-0737ef0b43ea tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Action: 'create', calling method: .version_select at 0x7f50377c3f70>, body: {"keypair": {"name": "tempest-keypair-1986502259", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLYULdKtMvfJAr3bdFoymsWGCfWyoPLJg11amjmFH9Qm7acZEKkYpgMpW3zEFACJsUJ71sxtUQm+ZujUlnjW1HBgJOW2UvSsQHMleQQrJI6MEsk/txDjB0dMS/+JKoTzRw=="}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:56:56.313703 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-65274bc2-7f92-4752-8869-0737ef0b43ea tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Getting quotas for project 12d4ca628b894615bc311c3705c4a801. Resources: {'key_pairs'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 09:56:56.329694 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-65274bc2-7f92-4752-8869-0737ef0b43ea tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Getting quotas for user e62d9d781281497e9927c0eb0e85dd75 and project 12d4ca628b894615bc311c3705c4a801. Resources: {'key_pairs'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 09:56:56.406477 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-65274bc2-7f92-4752-8869-0737ef0b43ea tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.649923 Jun 03 09:56:56.407633 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 15/33] 10.222.0.45 () {60 vars in 1158 bytes} [Fri Jun 3 09:56:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:56:56.432959 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-4e48ed54-9064-4dfd-91c5-9e260c432817 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:56:56.433728 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-4e48ed54-9064-4dfd-91c5-9e260c432817 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] [instance: 85a66cd0-df20-4640-849b-73f7f01329b9] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:56:56.459106 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4e48ed54-9064-4dfd-91c5-9e260c432817 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:56:56.459562 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4e48ed54-9064-4dfd-91c5-9e260c432817 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:56:56.460359 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4e48ed54-9064-4dfd-91c5-9e260c432817 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:56:56.460921 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4e48ed54-9064-4dfd-91c5-9e260c432817 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:56:56.804193 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-dc7f05d8-ee50-4061-8334-73ad58bbdc39 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Flavor limits 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 09:56:56.804743 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-dc7f05d8-ee50-4061-8334-73ad58bbdc39 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Image limits 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 09:56:56.805158 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-dc7f05d8-ee50-4061-8334-73ad58bbdc39 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Flavor pref 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 09:56:56.805579 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-dc7f05d8-ee50-4061-8334-73ad58bbdc39 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Image pref 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 09:56:56.806022 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-dc7f05d8-ee50-4061-8334-73ad58bbdc39 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 09:56:56.818286 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-dc7f05d8-ee50-4061-8334-73ad58bbdc39 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:56:56.818726 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-dc7f05d8-ee50-4061-8334-73ad58bbdc39 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:56:56.819854 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-dc7f05d8-ee50-4061-8334-73ad58bbdc39 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:56:56.820457 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-dc7f05d8-ee50-4061-8334-73ad58bbdc39 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:56:56.841123 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-dc7f05d8-ee50-4061-8334-73ad58bbdc39 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Getting quotas for project a937f473cd1b44bc8d628c7cadb18856. Resources: {'ram', 'cores', 'instances'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 09:56:56.846181 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-dc7f05d8-ee50-4061-8334-73ad58bbdc39 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Getting quotas for user c216711b9e9b45f09f4917fe7b8275ab and project a937f473cd1b44bc8d628c7cadb18856. Resources: {'ram', 'cores', 'instances'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 09:56:56.868502 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-dc7f05d8-ee50-4061-8334-73ad58bbdc39 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Going to run 1 instances... {{(pid=117648) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 09:56:56.871580 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-dc7f05d8-ee50-4061-8334-73ad58bbdc39 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0cb3b007-4e95-448b-8acb-895d8acdb244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 09:56:56.914989 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-4e48ed54-9064-4dfd-91c5-9e260c432817 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e257ae4e744dd8a0553b7c2abee529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae18a142aa2049ffa07fc6516203f6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:56:56.925485 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-4e48ed54-9064-4dfd-91c5-9e260c432817 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] 10.222.0.45 "GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9" status: 200 len: 1315 microversion: 2.1 time: 0.514214 Jun 03 09:56:56.930701 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-dc7f05d8-ee50-4061-8334-73ad58bbdc39 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.622353 Jun 03 09:56:56.932469 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 19/34] 10.222.0.45 () {62 vars in 1187 bytes} [Fri Jun 3 09:56:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 2627 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 03 09:56:56.934048 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 16/35] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:56:56 2022] GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9 => generated 1315 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:56:56.938627 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-e9ea9e57-71b2-4a14-8572-836db83bbe21 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:56:56.939505 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-e9ea9e57-71b2-4a14-8572-836db83bbe21 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:56:56.947988 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-4d0b6cfb-17b8-4ee2-93f1-026b93a64ec7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:56:56.948628 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-4d0b6cfb-17b8-4ee2-93f1-026b93a64ec7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:56:56.953454 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e9ea9e57-71b2-4a14-8572-836db83bbe21 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:56:56.954828 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e9ea9e57-71b2-4a14-8572-836db83bbe21 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:56:56.955917 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e9ea9e57-71b2-4a14-8572-836db83bbe21 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:56:56.956736 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e9ea9e57-71b2-4a14-8572-836db83bbe21 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:56:57.096546 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-e9ea9e57-71b2-4a14-8572-836db83bbe21 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:56:57.102806 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-4d0b6cfb-17b8-4ee2-93f1-026b93a64ec7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:56:57.108107 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-e9ea9e57-71b2-4a14-8572-836db83bbe21 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1274 microversion: 2.1 time: 0.174268 Jun 03 09:56:57.112242 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 20/36] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:56:56 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1274 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:56:57.114903 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-4d0b6cfb-17b8-4ee2-93f1-026b93a64ec7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:56:57.118794 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-4d0b6cfb-17b8-4ee2-93f1-026b93a64ec7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:56:57.122268 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-4d0b6cfb-17b8-4ee2-93f1-026b93a64ec7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1282 microversion: 2.20 time: 0.182148 Jun 03 09:56:57.124526 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 17/37] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 09:56:56 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1282 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:56:57.952724 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-03348d82-d16f-4d74-9979-e3add9125d99 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:56:57.953399 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-03348d82-d16f-4d74-9979-e3add9125d99 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] [instance: 85a66cd0-df20-4640-849b-73f7f01329b9] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:56:57.978967 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-03348d82-d16f-4d74-9979-e3add9125d99 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:56:57.987808 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-03348d82-d16f-4d74-9979-e3add9125d99 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:56:57.992775 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-03348d82-d16f-4d74-9979-e3add9125d99 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:56:57.995000 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-03348d82-d16f-4d74-9979-e3add9125d99 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:56:58.130455 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-b2e6fa4e-d40c-420b-92f0-f860a13e2ad9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:56:58.133450 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-b2e6fa4e-d40c-420b-92f0-f860a13e2ad9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:56:58.167386 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b2e6fa4e-d40c-420b-92f0-f860a13e2ad9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:56:58.169685 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b2e6fa4e-d40c-420b-92f0-f860a13e2ad9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:56:58.170825 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b2e6fa4e-d40c-420b-92f0-f860a13e2ad9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:56:58.174567 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b2e6fa4e-d40c-420b-92f0-f860a13e2ad9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:56:58.702409 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-b2e6fa4e-d40c-420b-92f0-f860a13e2ad9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:56:58.734431 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-b2e6fa4e-d40c-420b-92f0-f860a13e2ad9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1292 microversion: 2.1 time: 0.608693 Jun 03 09:56:58.745212 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 18/38] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:56:58 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1292 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:56:58.745212 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-d05eef08-072f-4926-8acf-bac6aee7e91d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:56:58.745212 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-d05eef08-072f-4926-8acf-bac6aee7e91d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:56:58.803812 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d05eef08-072f-4926-8acf-bac6aee7e91d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:56:58.808222 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d05eef08-072f-4926-8acf-bac6aee7e91d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:56:58.810126 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d05eef08-072f-4926-8acf-bac6aee7e91d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:56:58.811933 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d05eef08-072f-4926-8acf-bac6aee7e91d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:56:59.287905 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell0:SELECT=4 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:56:59.647229 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-d05eef08-072f-4926-8acf-bac6aee7e91d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:56:59.662154 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-d05eef08-072f-4926-8acf-bac6aee7e91d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:56:59.663981 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-d05eef08-072f-4926-8acf-bac6aee7e91d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:56:59.683283 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-d05eef08-072f-4926-8acf-bac6aee7e91d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1334 microversion: 2.20 time: 0.944755 Jun 03 09:56:59.685049 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 19/39] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 09:56:58 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1334 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:56:59.751857 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-dfb6e757-3db0-4f2c-a060-f51402982bd1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:56:59.752738 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-dfb6e757-3db0-4f2c-a060-f51402982bd1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:56:59.775195 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-dfb6e757-3db0-4f2c-a060-f51402982bd1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:56:59.778063 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-dfb6e757-3db0-4f2c-a060-f51402982bd1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:56:59.779230 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-dfb6e757-3db0-4f2c-a060-f51402982bd1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:56:59.780505 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-dfb6e757-3db0-4f2c-a060-f51402982bd1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:00.104922 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-03348d82-d16f-4d74-9979-e3add9125d99 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e257ae4e744dd8a0553b7c2abee529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae18a142aa2049ffa07fc6516203f6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:00.122498 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-03348d82-d16f-4d74-9979-e3add9125d99 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] 10.222.0.45 "GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9" status: 200 len: 1315 microversion: 2.1 time: 2.168385 Jun 03 09:57:00.122991 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-dfb6e757-3db0-4f2c-a060-f51402982bd1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:00.125450 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 21/40] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:56:57 2022] GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9 => generated 1315 bytes in 2179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:00.158044 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-dfb6e757-3db0-4f2c-a060-f51402982bd1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1280 microversion: 2.1 time: 0.409466 Jun 03 09:57:00.159512 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 20/41] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:56:59 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1280 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:57:00.704523 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-a52d3d3f-0044-4b64-8156-4244afb59214 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:00.705442 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-a52d3d3f-0044-4b64-8156-4244afb59214 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:00.728369 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a52d3d3f-0044-4b64-8156-4244afb59214 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:00.729157 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a52d3d3f-0044-4b64-8156-4244afb59214 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:00.730693 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a52d3d3f-0044-4b64-8156-4244afb59214 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:00.733298 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a52d3d3f-0044-4b64-8156-4244afb59214 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:01.139827 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-4b1d7277-4361-44cc-aea8-15fa0f785020 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:01.141667 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-4b1d7277-4361-44cc-aea8-15fa0f785020 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] [instance: 85a66cd0-df20-4640-849b-73f7f01329b9] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:01.152710 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4b1d7277-4361-44cc-aea8-15fa0f785020 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:01.158052 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4b1d7277-4361-44cc-aea8-15fa0f785020 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:01.163198 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4b1d7277-4361-44cc-aea8-15fa0f785020 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:01.165283 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4b1d7277-4361-44cc-aea8-15fa0f785020 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:01.745038 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-a52d3d3f-0044-4b64-8156-4244afb59214 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:01.767900 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-a52d3d3f-0044-4b64-8156-4244afb59214 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:01.770073 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-a52d3d3f-0044-4b64-8156-4244afb59214 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:01.775407 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-a52d3d3f-0044-4b64-8156-4244afb59214 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1352 microversion: 2.20 time: 1.076002 Jun 03 09:57:01.778020 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 22/42] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 09:57:00 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1352 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:57:01.791841 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-d28ef2ea-8a6a-418f-ac9f-0556e9e0118b tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:01.792160 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-d28ef2ea-8a6a-418f-ac9f-0556e9e0118b tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:01.837495 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d28ef2ea-8a6a-418f-ac9f-0556e9e0118b tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:01.838204 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d28ef2ea-8a6a-418f-ac9f-0556e9e0118b tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:01.839422 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d28ef2ea-8a6a-418f-ac9f-0556e9e0118b tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:01.841062 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d28ef2ea-8a6a-418f-ac9f-0556e9e0118b tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:02.877350 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-4b1d7277-4361-44cc-aea8-15fa0f785020 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e257ae4e744dd8a0553b7c2abee529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae18a142aa2049ffa07fc6516203f6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:02.887249 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-4b1d7277-4361-44cc-aea8-15fa0f785020 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] 10.222.0.45 "GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9" status: 200 len: 1315 microversion: 2.1 time: 1.751691 Jun 03 09:57:02.898164 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 21/43] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:01 2022] GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9 => generated 1315 bytes in 1763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:57:02.914174 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-5f43b846-8bd8-4b8d-ac8d-6d94641882d4 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:02.914914 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-5f43b846-8bd8-4b8d-ac8d-6d94641882d4 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:02.926384 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5f43b846-8bd8-4b8d-ac8d-6d94641882d4 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:02.944278 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5f43b846-8bd8-4b8d-ac8d-6d94641882d4 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:02.945408 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5f43b846-8bd8-4b8d-ac8d-6d94641882d4 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:02.946045 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5f43b846-8bd8-4b8d-ac8d-6d94641882d4 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:03.876391 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-5f43b846-8bd8-4b8d-ac8d-6d94641882d4 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:03.901278 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-5f43b846-8bd8-4b8d-ac8d-6d94641882d4 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:03.921810 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-5f43b846-8bd8-4b8d-ac8d-6d94641882d4 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:03.924878 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-5f43b846-8bd8-4b8d-ac8d-6d94641882d4 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1340 microversion: 2.20 time: 1.025584 Jun 03 09:57:03.927161 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 22/44] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 09:57:02 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1340 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:57:03.933309 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-8155e593-858d-4f2b-a0e4-39cc47fd6021 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:03.969315 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-8155e593-858d-4f2b-a0e4-39cc47fd6021 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] [instance: 85a66cd0-df20-4640-849b-73f7f01329b9] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:03.995229 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8155e593-858d-4f2b-a0e4-39cc47fd6021 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:03.995685 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8155e593-858d-4f2b-a0e4-39cc47fd6021 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:03.996467 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8155e593-858d-4f2b-a0e4-39cc47fd6021 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:03.997025 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8155e593-858d-4f2b-a0e4-39cc47fd6021 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:04.829505 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d28ef2ea-8a6a-418f-ac9f-0556e9e0118b tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:04.853924 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-d28ef2ea-8a6a-418f-ac9f-0556e9e0118b tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1322 microversion: 2.1 time: 3.071291 Jun 03 09:57:04.858873 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 23/45] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:01 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1322 bytes in 3080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:04.948167 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-993dc744-23cf-40cb-aff1-a507f2dc6ab7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:04.948850 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-993dc744-23cf-40cb-aff1-a507f2dc6ab7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:04.974165 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-993dc744-23cf-40cb-aff1-a507f2dc6ab7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:04.974727 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-993dc744-23cf-40cb-aff1-a507f2dc6ab7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:04.980868 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-993dc744-23cf-40cb-aff1-a507f2dc6ab7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:04.981345 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-993dc744-23cf-40cb-aff1-a507f2dc6ab7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:05.978131 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-8155e593-858d-4f2b-a0e4-39cc47fd6021 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e257ae4e744dd8a0553b7c2abee529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae18a142aa2049ffa07fc6516203f6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:06.008827 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-8155e593-858d-4f2b-a0e4-39cc47fd6021 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] 10.222.0.45 "GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9" status: 200 len: 1315 microversion: 2.1 time: 2.077082 Jun 03 09:57:06.011316 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 23/46] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:03 2022] GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9 => generated 1315 bytes in 2083 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:06.163179 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-993dc744-23cf-40cb-aff1-a507f2dc6ab7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:06.178475 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-993dc744-23cf-40cb-aff1-a507f2dc6ab7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:06.182533 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-993dc744-23cf-40cb-aff1-a507f2dc6ab7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:06.196817 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-993dc744-23cf-40cb-aff1-a507f2dc6ab7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1340 microversion: 2.20 time: 1.254647 Jun 03 09:57:06.203187 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 24/47] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 09:57:04 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1340 bytes in 1262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:57:06.233102 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-76ba1f3a-feaa-48a4-81f2-993fcc096fa3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:06.235926 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-76ba1f3a-feaa-48a4-81f2-993fcc096fa3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:06.256614 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-76ba1f3a-feaa-48a4-81f2-993fcc096fa3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:06.268977 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-76ba1f3a-feaa-48a4-81f2-993fcc096fa3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:06.270240 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-76ba1f3a-feaa-48a4-81f2-993fcc096fa3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:06.272318 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-76ba1f3a-feaa-48a4-81f2-993fcc096fa3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:06.644041 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-d1fb540d-1e04-4c3d-92bc-a39bb8060003 req-e905b485-9e19-4bdc-b034-6b90e357c377 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85a66cd0-df20-4640-849b-73f7f01329b9", "tag": "736d00ec-ca8b-4f89-9a8a-c45962886815"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:57:06.703886 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-d1fb540d-1e04-4c3d-92bc-a39bb8060003 req-e905b485-9e19-4bdc-b034-6b90e357c377 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:06.711133 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-d1fb540d-1e04-4c3d-92bc-a39bb8060003 req-e905b485-9e19-4bdc-b034-6b90e357c377 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:06.815466 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-d1fb540d-1e04-4c3d-92bc-a39bb8060003 req-e905b485-9e19-4bdc-b034-6b90e357c377 service nova] Creating event network-changed:736d00ec-ca8b-4f89-9a8a-c45962886815 for instance 85a66cd0-df20-4640-849b-73f7f01329b9 on hv-cinder-79760 Jun 03 09:57:06.816017 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-d1fb540d-1e04-4c3d-92bc-a39bb8060003 req-e905b485-9e19-4bdc-b034-6b90e357c377 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117647) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 03 09:57:06.826822 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3a8d0d4f-a8a0-49b2-996a-b72babecd6c4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:06.831332 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell0:SELECT=4 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:06.833770 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3a8d0d4f-a8a0-49b2-996a-b72babecd6c4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:06.835733 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3a8d0d4f-a8a0-49b2-996a-b72babecd6c4 None None] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:06.838341 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3a8d0d4f-a8a0-49b2-996a-b72babecd6c4 None None] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:06.865349 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell0:SELECT=22 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:06.882701 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.compute.rpcapi [None req-3a8d0d4f-a8a0-49b2-996a-b72babecd6c4 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 03 09:57:06.890795 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3a8d0d4f-a8a0-49b2-996a-b72babecd6c4 None None] Releasing lock "compute-rpcapi-router" {{(pid=117647) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 03 09:57:06.932929 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-3a8d0d4f-a8a0-49b2-996a-b72babecd6c4 None None] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.917750 Jun 03 09:57:06.933550 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 24/48] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 09:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:57:07.029010 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-fffd51cd-81ee-415d-8486-ce1e152e062b tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:07.029734 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-fffd51cd-81ee-415d-8486-ce1e152e062b tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] [instance: 85a66cd0-df20-4640-849b-73f7f01329b9] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:07.059238 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-fffd51cd-81ee-415d-8486-ce1e152e062b tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:07.059725 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-fffd51cd-81ee-415d-8486-ce1e152e062b tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:07.077455 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-fffd51cd-81ee-415d-8486-ce1e152e062b tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:07.077998 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-fffd51cd-81ee-415d-8486-ce1e152e062b tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:07.116054 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell0:SELECT=20 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:08.580033 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-fffd51cd-81ee-415d-8486-ce1e152e062b tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e257ae4e744dd8a0553b7c2abee529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae18a142aa2049ffa07fc6516203f6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:08.594038 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-fffd51cd-81ee-415d-8486-ce1e152e062b tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] 10.222.0.45 "GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9" status: 200 len: 1315 microversion: 2.1 time: 1.569374 Jun 03 09:57:08.595003 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 25/49] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:07 2022] GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9 => generated 1315 bytes in 1571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:57:08.600108 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-5c15f51e-5970-4229-bd01-867933c79120 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:08.600722 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-5c15f51e-5970-4229-bd01-867933c79120 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:08.612540 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-76ba1f3a-feaa-48a4-81f2-993fcc096fa3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:08.617925 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5c15f51e-5970-4229-bd01-867933c79120 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:08.618597 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5c15f51e-5970-4229-bd01-867933c79120 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:08.620146 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5c15f51e-5970-4229-bd01-867933c79120 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:08.620733 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5c15f51e-5970-4229-bd01-867933c79120 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:08.641429 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-76ba1f3a-feaa-48a4-81f2-993fcc096fa3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1322 microversion: 2.1 time: 2.434802 Jun 03 09:57:08.645202 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 25/50] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:06 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1322 bytes in 2440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:08.712246 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-51eaac9b-8943-4b99-ae80-16216e364463 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-168708629", "imageRef": "0cb3b007-4e95-448b-8acb-895d8acdb244", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3baa3021-e41d-411e-bddb-b3793d770962"}], "security_groups": [{"name": "tempest-securitygroup--59686547"}], "key_name": "tempest-keypair-1986502259", "user_data": "}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:57:08.731851 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=7 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:08.739783 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-5c15f51e-5970-4229-bd01-867933c79120 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:08.749055 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-5c15f51e-5970-4229-bd01-867933c79120 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:08.751187 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-5c15f51e-5970-4229-bd01-867933c79120 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:08.752273 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-5c15f51e-5970-4229-bd01-867933c79120 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1340 microversion: 2.20 time: 0.156147 Jun 03 09:57:08.752834 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 26/51] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 09:57:08 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1340 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:57:09.108349 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.network.neutron [None req-51eaac9b-8943-4b99-ae80-16216e364463 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] validate_networks() for [('3baa3021-e41d-411e-bddb-b3793d770962', None, None, None, None, None)] {{(pid=117648) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 09:57:09.337563 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-180a48e9-1adb-47a7-b418-a92e08198bf8 req-b8898526-1c5f-407f-b2e7-3263a45cc94a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "489e83ce-4f5c-4a0c-a3c0-07379977a7b4", "tag": "d3dc5ae5-4b40-44f3-b52a-fe25f2c19221"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:57:09.354948 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-180a48e9-1adb-47a7-b418-a92e08198bf8 req-b8898526-1c5f-407f-b2e7-3263a45cc94a service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:09.355991 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-180a48e9-1adb-47a7-b418-a92e08198bf8 req-b8898526-1c5f-407f-b2e7-3263a45cc94a service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:09.382882 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-180a48e9-1adb-47a7-b418-a92e08198bf8 req-b8898526-1c5f-407f-b2e7-3263a45cc94a service nova] Creating event network-changed:d3dc5ae5-4b40-44f3-b52a-fe25f2c19221 for instance 489e83ce-4f5c-4a0c-a3c0-07379977a7b4 on hv-cinder-79760 Jun 03 09:57:09.406500 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-180a48e9-1adb-47a7-b418-a92e08198bf8 req-b8898526-1c5f-407f-b2e7-3263a45cc94a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073007 Jun 03 09:57:09.407953 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 27/52] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 09:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 09:57:09.611947 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-ab1aeafa-95f8-47e7-ab56-a473881c846b tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:09.612669 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-ab1aeafa-95f8-47e7-ab56-a473881c846b tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] [instance: 85a66cd0-df20-4640-849b-73f7f01329b9] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:09.630174 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ab1aeafa-95f8-47e7-ab56-a473881c846b tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:09.630682 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ab1aeafa-95f8-47e7-ab56-a473881c846b tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:09.631672 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ab1aeafa-95f8-47e7-ab56-a473881c846b tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:09.632266 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ab1aeafa-95f8-47e7-ab56-a473881c846b tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:10.437635 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-ab1aeafa-95f8-47e7-ab56-a473881c846b tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e257ae4e744dd8a0553b7c2abee529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae18a142aa2049ffa07fc6516203f6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:10.450640 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-ab1aeafa-95f8-47e7-ab56-a473881c846b tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] 10.222.0.45 "GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9" status: 200 len: 1315 microversion: 2.1 time: 0.843398 Jun 03 09:57:10.451925 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 28/53] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:09 2022] GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9 => generated 1315 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:57:10.461695 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-69e48ebb-4d1a-4c28-b377-3f1816f4f129 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:10.466845 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-69e48ebb-4d1a-4c28-b377-3f1816f4f129 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:10.480003 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-69e48ebb-4d1a-4c28-b377-3f1816f4f129 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:10.481631 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-69e48ebb-4d1a-4c28-b377-3f1816f4f129 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:10.482671 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-69e48ebb-4d1a-4c28-b377-3f1816f4f129 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:10.483321 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-69e48ebb-4d1a-4c28-b377-3f1816f4f129 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:11.018110 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-51eaac9b-8943-4b99-ae80-16216e364463 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Flavor limits 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 09:57:11.019105 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-51eaac9b-8943-4b99-ae80-16216e364463 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Image limits 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 09:57:11.019826 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-51eaac9b-8943-4b99-ae80-16216e364463 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Flavor pref 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 09:57:11.020709 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-51eaac9b-8943-4b99-ae80-16216e364463 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Image pref 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 09:57:11.021348 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-51eaac9b-8943-4b99-ae80-16216e364463 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 09:57:11.031689 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-51eaac9b-8943-4b99-ae80-16216e364463 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:11.033177 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-51eaac9b-8943-4b99-ae80-16216e364463 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:11.034641 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-51eaac9b-8943-4b99-ae80-16216e364463 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:11.035273 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-51eaac9b-8943-4b99-ae80-16216e364463 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:11.057335 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-51eaac9b-8943-4b99-ae80-16216e364463 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Getting quotas for project 12d4ca628b894615bc311c3705c4a801. Resources: {'ram', 'cores', 'instances'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 09:57:11.061423 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-51eaac9b-8943-4b99-ae80-16216e364463 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Getting quotas for user e62d9d781281497e9927c0eb0e85dd75 and project 12d4ca628b894615bc311c3705c4a801. Resources: {'ram', 'cores', 'instances'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 09:57:11.074326 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-51eaac9b-8943-4b99-ae80-16216e364463 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Going to run 1 instances... {{(pid=117648) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 09:57:11.076695 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-51eaac9b-8943-4b99-ae80-16216e364463 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0cb3b007-4e95-448b-8acb-895d8acdb244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 09:57:11.097185 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-69e48ebb-4d1a-4c28-b377-3f1816f4f129 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:11.104318 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=100 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:11.108512 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-69e48ebb-4d1a-4c28-b377-3f1816f4f129 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1322 microversion: 2.1 time: 0.655296 Jun 03 09:57:11.119282 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 29/54] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:10 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1322 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:11.124371 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-8b0d4cff-4040-4cd3-a8d8-1d15f8b563fb tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:11.125163 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-8b0d4cff-4040-4cd3-a8d8-1d15f8b563fb tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:11.132028 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8b0d4cff-4040-4cd3-a8d8-1d15f8b563fb tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:11.132569 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8b0d4cff-4040-4cd3-a8d8-1d15f8b563fb tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:11.133687 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8b0d4cff-4040-4cd3-a8d8-1d15f8b563fb tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:11.134320 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8b0d4cff-4040-4cd3-a8d8-1d15f8b563fb tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:11.176459 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-51eaac9b-8943-4b99-ae80-16216e364463 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 2.473606 Jun 03 09:57:11.181830 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 26/55] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jun 3 09:57:08 2022] POST /compute/v2.1/servers => generated 400 bytes in 2475 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 09:57:11.369000 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-d5a6f516-3d0a-4ab0-a552-31c68759ed02 req-4b82cc72-2fb7-441b-bf56-34adb6957dc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59f3fa08-01f7-45d5-ae2b-171882dbc9c5", "tag": "fa8981dc-7a31-4c90-a538-73142807983c"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:57:11.385143 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-d5a6f516-3d0a-4ab0-a552-31c68759ed02 req-4b82cc72-2fb7-441b-bf56-34adb6957dc5 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:11.385616 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-d5a6f516-3d0a-4ab0-a552-31c68759ed02 req-4b82cc72-2fb7-441b-bf56-34adb6957dc5 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:11.408729 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-d5a6f516-3d0a-4ab0-a552-31c68759ed02 req-4b82cc72-2fb7-441b-bf56-34adb6957dc5 service nova] Creating event network-changed:fa8981dc-7a31-4c90-a538-73142807983c for instance 59f3fa08-01f7-45d5-ae2b-171882dbc9c5 on hv-cinder-79760 Jun 03 09:57:11.409274 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-d5a6f516-3d0a-4ab0-a552-31c68759ed02 req-4b82cc72-2fb7-441b-bf56-34adb6957dc5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117648) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 03 09:57:11.410619 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d04bcda5-5dbc-4b3f-ba30-7905fda61063 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:11.411229 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d04bcda5-5dbc-4b3f-ba30-7905fda61063 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:11.412026 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d04bcda5-5dbc-4b3f-ba30-7905fda61063 None None] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:11.412467 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d04bcda5-5dbc-4b3f-ba30-7905fda61063 None None] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:11.422337 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.compute.rpcapi [None req-d04bcda5-5dbc-4b3f-ba30-7905fda61063 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 03 09:57:11.423262 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d04bcda5-5dbc-4b3f-ba30-7905fda61063 None None] Releasing lock "compute-rpcapi-router" {{(pid=117648) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 03 09:57:11.440845 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-d04bcda5-5dbc-4b3f-ba30-7905fda61063 None None] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.261938 Jun 03 09:57:11.441674 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 27/56] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 09:57:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:57:11.447521 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-7325669a-a652-48ef-a91f-594c1f5eb837 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:11.448624 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-7325669a-a652-48ef-a91f-594c1f5eb837 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:11.484535 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-8b0d4cff-4040-4cd3-a8d8-1d15f8b563fb tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:11.493634 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-8b0d4cff-4040-4cd3-a8d8-1d15f8b563fb tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:11.495283 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-8b0d4cff-4040-4cd3-a8d8-1d15f8b563fb tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:11.496936 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-8b0d4cff-4040-4cd3-a8d8-1d15f8b563fb tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1407 microversion: 2.20 time: 0.376476 Jun 03 09:57:11.497506 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 30/57] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 09:57:11 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1407 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:57:11.512813 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-615a0624-3500-4c39-9b55-bf458f915ea0 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:11.513704 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-615a0624-3500-4c39-9b55-bf458f915ea0 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] [instance: 85a66cd0-df20-4640-849b-73f7f01329b9] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:11.519713 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=7 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:11.521716 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-615a0624-3500-4c39-9b55-bf458f915ea0 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:11.522200 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-615a0624-3500-4c39-9b55-bf458f915ea0 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:11.525099 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-615a0624-3500-4c39-9b55-bf458f915ea0 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:11.525779 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-615a0624-3500-4c39-9b55-bf458f915ea0 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:11.557709 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-7325669a-a652-48ef-a91f-594c1f5eb837 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:11.570956 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-7325669a-a652-48ef-a91f-594c1f5eb837 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e" status: 200 len: 1241 microversion: 2.1 time: 0.127453 Jun 03 09:57:11.573968 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 28/58] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:11 2022] GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e => generated 1241 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:11.818174 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-615a0624-3500-4c39-9b55-bf458f915ea0 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e257ae4e744dd8a0553b7c2abee529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae18a142aa2049ffa07fc6516203f6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:11.842133 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-615a0624-3500-4c39-9b55-bf458f915ea0 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] 10.222.0.45 "GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9" status: 200 len: 1315 microversion: 2.1 time: 0.330923 Jun 03 09:57:11.843312 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 31/59] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:11 2022] GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9 => generated 1315 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:12.135561 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-853297bf-a0f5-4457-9708-9651455b76f4 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:12.136186 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-853297bf-a0f5-4457-9708-9651455b76f4 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:12.148866 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-853297bf-a0f5-4457-9708-9651455b76f4 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:12.150829 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-853297bf-a0f5-4457-9708-9651455b76f4 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:12.152069 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-853297bf-a0f5-4457-9708-9651455b76f4 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:12.154194 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-853297bf-a0f5-4457-9708-9651455b76f4 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:12.515956 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-5bc48ae5-4dde-4be3-ac7d-412398462501 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:12.517123 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-5bc48ae5-4dde-4be3-ac7d-412398462501 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:12.531862 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5bc48ae5-4dde-4be3-ac7d-412398462501 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:12.544058 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5bc48ae5-4dde-4be3-ac7d-412398462501 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:12.545208 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5bc48ae5-4dde-4be3-ac7d-412398462501 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:12.546053 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5bc48ae5-4dde-4be3-ac7d-412398462501 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:12.745900 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-853297bf-a0f5-4457-9708-9651455b76f4 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:12.756253 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-853297bf-a0f5-4457-9708-9651455b76f4 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1322 microversion: 2.1 time: 0.624743 Jun 03 09:57:12.759680 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 29/60] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:12 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1322 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:12.769674 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-dfbb2cd9-e254-4c54-b7bc-a2d271ff23ab tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:12.770613 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-dfbb2cd9-e254-4c54-b7bc-a2d271ff23ab tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:12.781424 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-dfbb2cd9-e254-4c54-b7bc-a2d271ff23ab tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:12.783010 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-dfbb2cd9-e254-4c54-b7bc-a2d271ff23ab tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:12.784827 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-dfbb2cd9-e254-4c54-b7bc-a2d271ff23ab tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:12.785716 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-dfbb2cd9-e254-4c54-b7bc-a2d271ff23ab tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:12.827428 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-5bc48ae5-4dde-4be3-ac7d-412398462501 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:12.840831 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-5bc48ae5-4dde-4be3-ac7d-412398462501 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:12.842698 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-5bc48ae5-4dde-4be3-ac7d-412398462501 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:12.844013 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-5bc48ae5-4dde-4be3-ac7d-412398462501 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1407 microversion: 2.20 time: 0.332728 Jun 03 09:57:12.856265 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 32/61] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 09:57:12 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1407 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:57:12.861742 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-1b7d631e-0f84-42f7-8c29-76ea85c574b0 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:12.862536 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-1b7d631e-0f84-42f7-8c29-76ea85c574b0 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] [instance: 85a66cd0-df20-4640-849b-73f7f01329b9] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:12.869870 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1b7d631e-0f84-42f7-8c29-76ea85c574b0 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:12.870269 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-dfbb2cd9-e254-4c54-b7bc-a2d271ff23ab tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:12.870695 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1b7d631e-0f84-42f7-8c29-76ea85c574b0 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:12.871765 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1b7d631e-0f84-42f7-8c29-76ea85c574b0 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:12.872355 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1b7d631e-0f84-42f7-8c29-76ea85c574b0 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:12.879839 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-dfbb2cd9-e254-4c54-b7bc-a2d271ff23ab tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e" status: 200 len: 1293 microversion: 2.1 time: 0.118926 Jun 03 09:57:12.882110 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 30/62] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:12 2022] GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e => generated 1293 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:13.509786 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-ca226058-2d94-4f72-ab3e-362bb09ebc46 req-9349fa4f-ad20-4f43-9ad2-bd90181bfe31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f", "tag": "d6b08e27-3091-4087-a29a-03ef6cbbdc0a"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:57:13.570287 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-ca226058-2d94-4f72-ab3e-362bb09ebc46 req-9349fa4f-ad20-4f43-9ad2-bd90181bfe31 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:13.570741 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-ca226058-2d94-4f72-ab3e-362bb09ebc46 req-9349fa4f-ad20-4f43-9ad2-bd90181bfe31 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:13.623634 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-ca226058-2d94-4f72-ab3e-362bb09ebc46 req-9349fa4f-ad20-4f43-9ad2-bd90181bfe31 service nova] Creating event network-changed:d6b08e27-3091-4087-a29a-03ef6cbbdc0a for instance 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f on hv-cinder-79760 Jun 03 09:57:13.637054 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-ca226058-2d94-4f72-ab3e-362bb09ebc46 req-9349fa4f-ad20-4f43-9ad2-bd90181bfe31 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142368 Jun 03 09:57:13.637054 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 31/63] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 09:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:57:13.660810 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-1b7d631e-0f84-42f7-8c29-76ea85c574b0 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e257ae4e744dd8a0553b7c2abee529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae18a142aa2049ffa07fc6516203f6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:13.668333 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-1b7d631e-0f84-42f7-8c29-76ea85c574b0 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] 10.222.0.45 "GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9" status: 200 len: 1315 microversion: 2.1 time: 0.810767 Jun 03 09:57:13.669020 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 33/64] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:12 2022] GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9 => generated 1315 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:13.780587 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-1854a893-3e1d-40f0-8f5b-3725a8c633e5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:13.781386 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-1854a893-3e1d-40f0-8f5b-3725a8c633e5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:13.790072 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1854a893-3e1d-40f0-8f5b-3725a8c633e5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:13.790810 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1854a893-3e1d-40f0-8f5b-3725a8c633e5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:13.791790 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1854a893-3e1d-40f0-8f5b-3725a8c633e5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:13.792425 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1854a893-3e1d-40f0-8f5b-3725a8c633e5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:13.863891 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-398a26a7-57e1-49be-abaa-794fe0982cfd tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:13.864946 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-398a26a7-57e1-49be-abaa-794fe0982cfd tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:13.876701 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-398a26a7-57e1-49be-abaa-794fe0982cfd tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:13.877619 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-398a26a7-57e1-49be-abaa-794fe0982cfd tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:13.879325 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-398a26a7-57e1-49be-abaa-794fe0982cfd tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:13.881364 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-398a26a7-57e1-49be-abaa-794fe0982cfd tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:14.179448 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-398a26a7-57e1-49be-abaa-794fe0982cfd tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:14.193790 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-398a26a7-57e1-49be-abaa-794fe0982cfd tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:14.195382 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-398a26a7-57e1-49be-abaa-794fe0982cfd tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:14.196534 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-398a26a7-57e1-49be-abaa-794fe0982cfd tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1407 microversion: 2.20 time: 0.337466 Jun 03 09:57:14.200312 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-1854a893-3e1d-40f0-8f5b-3725a8c633e5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:14.207027 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 34/65] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 09:57:13 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1407 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:57:14.216482 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-1854a893-3e1d-40f0-8f5b-3725a8c633e5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1322 microversion: 2.1 time: 0.444091 Jun 03 09:57:14.223938 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-6360ee88-37d8-4bfa-b3a1-60da0aa03222 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:14.224577 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-6360ee88-37d8-4bfa-b3a1-60da0aa03222 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:14.226261 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 32/66] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:13 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1322 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:14.237934 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6360ee88-37d8-4bfa-b3a1-60da0aa03222 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:14.238382 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6360ee88-37d8-4bfa-b3a1-60da0aa03222 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:14.239161 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6360ee88-37d8-4bfa-b3a1-60da0aa03222 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:14.239593 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6360ee88-37d8-4bfa-b3a1-60da0aa03222 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:14.358168 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-6360ee88-37d8-4bfa-b3a1-60da0aa03222 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:14.372619 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-6360ee88-37d8-4bfa-b3a1-60da0aa03222 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e" status: 200 len: 1299 microversion: 2.1 time: 0.163672 Jun 03 09:57:14.381809 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 35/67] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:14 2022] GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e => generated 1299 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:14.685314 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-fcad2b12-f9af-4a28-abbc-33de5ddaa2cd tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:14.685973 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-fcad2b12-f9af-4a28-abbc-33de5ddaa2cd tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] [instance: 85a66cd0-df20-4640-849b-73f7f01329b9] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:14.703423 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fcad2b12-f9af-4a28-abbc-33de5ddaa2cd tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:14.704663 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fcad2b12-f9af-4a28-abbc-33de5ddaa2cd tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:14.706570 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fcad2b12-f9af-4a28-abbc-33de5ddaa2cd tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:14.711295 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fcad2b12-f9af-4a28-abbc-33de5ddaa2cd tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:15.217340 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-9f29c389-9219-4687-bb8c-971439ac182a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:15.219244 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-9f29c389-9219-4687-bb8c-971439ac182a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:15.233183 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9f29c389-9219-4687-bb8c-971439ac182a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:15.233660 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9f29c389-9219-4687-bb8c-971439ac182a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:15.234553 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9f29c389-9219-4687-bb8c-971439ac182a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:15.240975 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9f29c389-9219-4687-bb8c-971439ac182a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:15.544076 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-fcad2b12-f9af-4a28-abbc-33de5ddaa2cd tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e257ae4e744dd8a0553b7c2abee529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae18a142aa2049ffa07fc6516203f6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:15.552958 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-fcad2b12-f9af-4a28-abbc-33de5ddaa2cd tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] 10.222.0.45 "GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9" status: 200 len: 1315 microversion: 2.1 time: 0.871999 Jun 03 09:57:15.553585 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 33/68] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:14 2022] GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9 => generated 1315 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:15.568850 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-f81e2a7d-3ff4-41cd-9c49-8beb62d53da3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:15.569837 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-f81e2a7d-3ff4-41cd-9c49-8beb62d53da3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:15.581446 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f81e2a7d-3ff4-41cd-9c49-8beb62d53da3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:15.582150 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f81e2a7d-3ff4-41cd-9c49-8beb62d53da3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:15.583519 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f81e2a7d-3ff4-41cd-9c49-8beb62d53da3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:15.584139 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f81e2a7d-3ff4-41cd-9c49-8beb62d53da3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:15.717604 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-9f29c389-9219-4687-bb8c-971439ac182a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:15.747089 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-9f29c389-9219-4687-bb8c-971439ac182a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:15.755286 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-9f29c389-9219-4687-bb8c-971439ac182a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:15.756780 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-9f29c389-9219-4687-bb8c-971439ac182a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1407 microversion: 2.20 time: 0.545418 Jun 03 09:57:15.757924 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 36/69] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 09:57:15 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1407 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:57:15.777364 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-e30de680-fd29-4bc1-9bcd-0b706c5e2b3f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:15.778565 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-e30de680-fd29-4bc1-9bcd-0b706c5e2b3f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:15.793289 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e30de680-fd29-4bc1-9bcd-0b706c5e2b3f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:15.793739 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e30de680-fd29-4bc1-9bcd-0b706c5e2b3f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:15.794895 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e30de680-fd29-4bc1-9bcd-0b706c5e2b3f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:15.795488 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e30de680-fd29-4bc1-9bcd-0b706c5e2b3f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:15.842232 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f81e2a7d-3ff4-41cd-9c49-8beb62d53da3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:15.854159 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-f81e2a7d-3ff4-41cd-9c49-8beb62d53da3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1322 microversion: 2.1 time: 0.289269 Jun 03 09:57:15.864111 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 34/70] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:15 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1322 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:16.011705 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-e30de680-fd29-4bc1-9bcd-0b706c5e2b3f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:16.024455 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-e30de680-fd29-4bc1-9bcd-0b706c5e2b3f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e" status: 200 len: 1365 microversion: 2.1 time: 0.252017 Jun 03 09:57:16.025265 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 37/71] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:15 2022] GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e => generated 1365 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:16.570883 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-efae30c2-8cf8-4c64-8d06-a4fb3bbe66b6 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:16.571712 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-efae30c2-8cf8-4c64-8d06-a4fb3bbe66b6 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] [instance: 85a66cd0-df20-4640-849b-73f7f01329b9] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:16.577657 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-efae30c2-8cf8-4c64-8d06-a4fb3bbe66b6 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:16.578300 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-efae30c2-8cf8-4c64-8d06-a4fb3bbe66b6 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:16.579824 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-efae30c2-8cf8-4c64-8d06-a4fb3bbe66b6 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:16.580434 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-efae30c2-8cf8-4c64-8d06-a4fb3bbe66b6 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:16.722565 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-efae30c2-8cf8-4c64-8d06-a4fb3bbe66b6 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e257ae4e744dd8a0553b7c2abee529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae18a142aa2049ffa07fc6516203f6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:16.730759 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-efae30c2-8cf8-4c64-8d06-a4fb3bbe66b6 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] 10.222.0.45 "GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9" status: 200 len: 1315 microversion: 2.1 time: 0.164108 Jun 03 09:57:16.731526 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 35/72] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:16 2022] GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:16.776110 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-ac119357-edd4-459f-aa20-7263bceffbb8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:16.777835 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-ac119357-edd4-459f-aa20-7263bceffbb8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:16.786746 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ac119357-edd4-459f-aa20-7263bceffbb8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:16.787500 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ac119357-edd4-459f-aa20-7263bceffbb8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:16.788422 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ac119357-edd4-459f-aa20-7263bceffbb8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:16.788860 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ac119357-edd4-459f-aa20-7263bceffbb8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:16.872556 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-66dabb53-5fa5-4025-8085-1f69ba2a073c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:16.873794 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-66dabb53-5fa5-4025-8085-1f69ba2a073c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:16.882372 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell0:SELECT=2 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:16.885133 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-66dabb53-5fa5-4025-8085-1f69ba2a073c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:16.886392 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-66dabb53-5fa5-4025-8085-1f69ba2a073c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:16.888841 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-66dabb53-5fa5-4025-8085-1f69ba2a073c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:16.889366 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-66dabb53-5fa5-4025-8085-1f69ba2a073c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:16.970378 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-ac119357-edd4-459f-aa20-7263bceffbb8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:16.988262 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-ac119357-edd4-459f-aa20-7263bceffbb8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:16.993833 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-ac119357-edd4-459f-aa20-7263bceffbb8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:16.996712 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-ac119357-edd4-459f-aa20-7263bceffbb8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1407 microversion: 2.20 time: 0.223644 Jun 03 09:57:16.997987 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 38/73] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 09:57:16 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:57:17.049765 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-94ee2369-7cba-4b0a-9b30-ac16804cc9e1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:17.050668 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-94ee2369-7cba-4b0a-9b30-ac16804cc9e1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:17.060012 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-94ee2369-7cba-4b0a-9b30-ac16804cc9e1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:17.060761 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-94ee2369-7cba-4b0a-9b30-ac16804cc9e1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:17.061772 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-94ee2369-7cba-4b0a-9b30-ac16804cc9e1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:17.062289 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-94ee2369-7cba-4b0a-9b30-ac16804cc9e1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:17.207216 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-66dabb53-5fa5-4025-8085-1f69ba2a073c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:17.222472 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-66dabb53-5fa5-4025-8085-1f69ba2a073c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1322 microversion: 2.1 time: 0.352336 Jun 03 09:57:17.225519 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 36/74] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:16 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1322 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:57:17.296536 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-94ee2369-7cba-4b0a-9b30-ac16804cc9e1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:17.310828 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-94ee2369-7cba-4b0a-9b30-ac16804cc9e1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e" status: 200 len: 1365 microversion: 2.1 time: 0.270736 Jun 03 09:57:17.312147 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 39/75] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:17 2022] GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e => generated 1365 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:57:17.750169 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-adba403b-70d8-450f-899e-92f36917fb42 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:17.752094 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-adba403b-70d8-450f-899e-92f36917fb42 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] [instance: 85a66cd0-df20-4640-849b-73f7f01329b9] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:17.767656 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-adba403b-70d8-450f-899e-92f36917fb42 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:17.768481 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-adba403b-70d8-450f-899e-92f36917fb42 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:17.771205 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-adba403b-70d8-450f-899e-92f36917fb42 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:17.773335 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-adba403b-70d8-450f-899e-92f36917fb42 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:17.790983 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell1:SELECT=97 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:18.017152 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-f4d0f4f2-4a32-403a-8203-d91274537854 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:18.018024 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-f4d0f4f2-4a32-403a-8203-d91274537854 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:18.026882 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f4d0f4f2-4a32-403a-8203-d91274537854 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:18.027337 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f4d0f4f2-4a32-403a-8203-d91274537854 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:18.029674 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f4d0f4f2-4a32-403a-8203-d91274537854 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:18.030236 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f4d0f4f2-4a32-403a-8203-d91274537854 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:18.215451 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-adba403b-70d8-450f-899e-92f36917fb42 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e257ae4e744dd8a0553b7c2abee529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae18a142aa2049ffa07fc6516203f6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:18.230461 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-adba403b-70d8-450f-899e-92f36917fb42 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] 10.222.0.45 "GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9" status: 200 len: 1315 microversion: 2.1 time: 0.485297 Jun 03 09:57:18.234051 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 37/76] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:17 2022] GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9 => generated 1315 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:18.252190 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-6f184930-1a94-4bae-94d4-b69a77359b68 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:18.256310 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-6f184930-1a94-4bae-94d4-b69a77359b68 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:18.275224 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6f184930-1a94-4bae-94d4-b69a77359b68 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:18.275981 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6f184930-1a94-4bae-94d4-b69a77359b68 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:18.276816 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6f184930-1a94-4bae-94d4-b69a77359b68 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:18.282145 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6f184930-1a94-4bae-94d4-b69a77359b68 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:18.674069 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-f4d0f4f2-4a32-403a-8203-d91274537854 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:18.690113 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-f4d0f4f2-4a32-403a-8203-d91274537854 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:18.695762 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-f4d0f4f2-4a32-403a-8203-d91274537854 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:18.697618 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-f4d0f4f2-4a32-403a-8203-d91274537854 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1407 microversion: 2.20 time: 0.686261 Jun 03 09:57:18.700537 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 40/77] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 09:57:18 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1407 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:57:18.708973 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-6f184930-1a94-4bae-94d4-b69a77359b68 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:18.712825 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-f4cd269d-af2f-4fbb-b6af-b0708cfbd4f7 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:18.713908 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-f4cd269d-af2f-4fbb-b6af-b0708cfbd4f7 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:18.717237 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-6f184930-1a94-4bae-94d4-b69a77359b68 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1322 microversion: 2.1 time: 0.478474 Jun 03 09:57:18.722174 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 38/78] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:18 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1322 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:18.724400 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f4cd269d-af2f-4fbb-b6af-b0708cfbd4f7 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:18.725743 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f4cd269d-af2f-4fbb-b6af-b0708cfbd4f7 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:18.726772 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f4cd269d-af2f-4fbb-b6af-b0708cfbd4f7 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:18.727941 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f4cd269d-af2f-4fbb-b6af-b0708cfbd4f7 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:19.015049 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-f4cd269d-af2f-4fbb-b6af-b0708cfbd4f7 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:19.024586 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-f4cd269d-af2f-4fbb-b6af-b0708cfbd4f7 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e" status: 200 len: 1365 microversion: 2.1 time: 0.322397 Jun 03 09:57:19.025239 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 41/79] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:18 2022] GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e => generated 1365 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:19.147201 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-2760f96e-e9b8-4389-bcc6-19161ae0e6a7 req-5140e463-d0ea-4332-a742-85281839c524 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e", "tag": "9ce3fd34-d579-4eda-8b0a-3d97ea2da07d"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:57:19.163668 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-2760f96e-e9b8-4389-bcc6-19161ae0e6a7 req-5140e463-d0ea-4332-a742-85281839c524 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:19.164118 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-2760f96e-e9b8-4389-bcc6-19161ae0e6a7 req-5140e463-d0ea-4332-a742-85281839c524 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:19.178349 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-2760f96e-e9b8-4389-bcc6-19161ae0e6a7 req-5140e463-d0ea-4332-a742-85281839c524 service nova] Creating event network-changed:9ce3fd34-d579-4eda-8b0a-3d97ea2da07d for instance 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e on hv-cinder-79760 Jun 03 09:57:19.188732 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-2760f96e-e9b8-4389-bcc6-19161ae0e6a7 req-5140e463-d0ea-4332-a742-85281839c524 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044970 Jun 03 09:57:19.190104 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 39/80] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 09:57:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 09:57:19.255869 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-e28626ae-d118-49f5-8696-ce687ccaf71d tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:19.256599 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-e28626ae-d118-49f5-8696-ce687ccaf71d tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] [instance: 85a66cd0-df20-4640-849b-73f7f01329b9] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:19.263180 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e28626ae-d118-49f5-8696-ce687ccaf71d tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:19.264109 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e28626ae-d118-49f5-8696-ce687ccaf71d tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:19.264982 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e28626ae-d118-49f5-8696-ce687ccaf71d tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:19.265627 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e28626ae-d118-49f5-8696-ce687ccaf71d tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:19.426590 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-e28626ae-d118-49f5-8696-ce687ccaf71d tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e257ae4e744dd8a0553b7c2abee529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae18a142aa2049ffa07fc6516203f6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:19.434645 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-e28626ae-d118-49f5-8696-ce687ccaf71d tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] 10.222.0.45 "GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9" status: 200 len: 1315 microversion: 2.1 time: 0.189435 Jun 03 09:57:19.437792 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 42/81] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:19 2022] GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9 => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:19.721720 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-907091c1-dbea-4f9e-91cb-f6c8019d922a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:19.722789 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-907091c1-dbea-4f9e-91cb-f6c8019d922a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:19.729674 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-907091c1-dbea-4f9e-91cb-f6c8019d922a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:19.730446 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-907091c1-dbea-4f9e-91cb-f6c8019d922a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:19.731409 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-907091c1-dbea-4f9e-91cb-f6c8019d922a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:19.738041 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-8b14ee94-e817-4df5-bd45-3b3c4b171a21 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:19.738790 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-8b14ee94-e817-4df5-bd45-3b3c4b171a21 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:19.745427 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8b14ee94-e817-4df5-bd45-3b3c4b171a21 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:19.745913 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8b14ee94-e817-4df5-bd45-3b3c4b171a21 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:19.746685 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8b14ee94-e817-4df5-bd45-3b3c4b171a21 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:19.747123 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8b14ee94-e817-4df5-bd45-3b3c4b171a21 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:19.751215 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-907091c1-dbea-4f9e-91cb-f6c8019d922a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:19.955329 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-907091c1-dbea-4f9e-91cb-f6c8019d922a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:19.964987 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-907091c1-dbea-4f9e-91cb-f6c8019d922a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:19.966927 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-907091c1-dbea-4f9e-91cb-f6c8019d922a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:19.968295 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-907091c1-dbea-4f9e-91cb-f6c8019d922a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1407 microversion: 2.20 time: 0.251431 Jun 03 09:57:19.969474 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 40/82] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 09:57:19 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1407 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:57:19.985987 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-8b14ee94-e817-4df5-bd45-3b3c4b171a21 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:19.994452 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-8b14ee94-e817-4df5-bd45-3b3c4b171a21 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1322 microversion: 2.1 time: 0.261208 Jun 03 09:57:19.995062 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 43/83] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:19 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1322 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:20.043055 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-8477fc12-7159-43fd-8082-1c4a7e99adae tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:20.043677 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-8477fc12-7159-43fd-8082-1c4a7e99adae tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:20.050389 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8477fc12-7159-43fd-8082-1c4a7e99adae tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:20.050849 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8477fc12-7159-43fd-8082-1c4a7e99adae tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:20.051632 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8477fc12-7159-43fd-8082-1c4a7e99adae tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:20.052087 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8477fc12-7159-43fd-8082-1c4a7e99adae tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:20.197312 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-8477fc12-7159-43fd-8082-1c4a7e99adae tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:20.205469 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-8477fc12-7159-43fd-8082-1c4a7e99adae tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e" status: 200 len: 1365 microversion: 2.1 time: 0.166138 Jun 03 09:57:20.217324 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 41/84] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:20 2022] GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:20.452116 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-6e908d85-8d45-4ae9-ae78-c3609dd488c2 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:20.452737 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-6e908d85-8d45-4ae9-ae78-c3609dd488c2 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] [instance: 85a66cd0-df20-4640-849b-73f7f01329b9] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:20.459464 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6e908d85-8d45-4ae9-ae78-c3609dd488c2 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:20.459948 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6e908d85-8d45-4ae9-ae78-c3609dd488c2 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:20.460722 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6e908d85-8d45-4ae9-ae78-c3609dd488c2 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:20.461156 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6e908d85-8d45-4ae9-ae78-c3609dd488c2 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:20.748262 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-6e908d85-8d45-4ae9-ae78-c3609dd488c2 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e257ae4e744dd8a0553b7c2abee529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae18a142aa2049ffa07fc6516203f6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:20.756169 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-6e908d85-8d45-4ae9-ae78-c3609dd488c2 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] 10.222.0.45 "GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9" status: 200 len: 1315 microversion: 2.1 time: 0.307938 Jun 03 09:57:20.756741 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 44/85] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:20 2022] GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9 => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:20.988439 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-cef1b1fc-2f6f-470b-af59-db04b086365b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:20.989053 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-cef1b1fc-2f6f-470b-af59-db04b086365b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:20.996825 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cef1b1fc-2f6f-470b-af59-db04b086365b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:20.997398 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cef1b1fc-2f6f-470b-af59-db04b086365b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:20.998595 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cef1b1fc-2f6f-470b-af59-db04b086365b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:20.999015 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cef1b1fc-2f6f-470b-af59-db04b086365b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:21.012292 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-25a9b99e-6f49-4756-af74-5404289351f1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:21.012917 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-25a9b99e-6f49-4756-af74-5404289351f1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:21.018924 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-25a9b99e-6f49-4756-af74-5404289351f1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:21.019375 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-25a9b99e-6f49-4756-af74-5404289351f1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:21.020138 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-25a9b99e-6f49-4756-af74-5404289351f1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:21.020578 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-25a9b99e-6f49-4756-af74-5404289351f1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:21.196866 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-cef1b1fc-2f6f-470b-af59-db04b086365b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:21.201177 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-25a9b99e-6f49-4756-af74-5404289351f1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:21.204877 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-cef1b1fc-2f6f-470b-af59-db04b086365b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:21.206434 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-cef1b1fc-2f6f-470b-af59-db04b086365b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:21.207546 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-cef1b1fc-2f6f-470b-af59-db04b086365b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1407 microversion: 2.20 time: 0.224583 Jun 03 09:57:21.208102 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 42/86] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 09:57:20 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:57:21.208809 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-25a9b99e-6f49-4756-af74-5404289351f1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1322 microversion: 2.1 time: 0.200230 Jun 03 09:57:21.209375 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 45/87] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:21 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:21.224792 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-e34103e3-c812-4b4c-979a-7f7db63751d7 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:21.225397 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-e34103e3-c812-4b4c-979a-7f7db63751d7 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:21.231389 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e34103e3-c812-4b4c-979a-7f7db63751d7 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:21.231834 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e34103e3-c812-4b4c-979a-7f7db63751d7 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:21.232589 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e34103e3-c812-4b4c-979a-7f7db63751d7 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:21.233022 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e34103e3-c812-4b4c-979a-7f7db63751d7 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:21.423453 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell0:SELECT=4 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:21.551190 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-e34103e3-c812-4b4c-979a-7f7db63751d7 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:21.559189 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-e34103e3-c812-4b4c-979a-7f7db63751d7 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e" status: 200 len: 1365 microversion: 2.1 time: 0.337953 Jun 03 09:57:21.559760 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 43/88] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:21 2022] GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e => generated 1365 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:21.777474 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-c12e1742-819c-4fe7-8d39-5880271c0c6a tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:21.778897 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-c12e1742-819c-4fe7-8d39-5880271c0c6a tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] [instance: 85a66cd0-df20-4640-849b-73f7f01329b9] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:21.787808 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c12e1742-819c-4fe7-8d39-5880271c0c6a tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:21.788257 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c12e1742-819c-4fe7-8d39-5880271c0c6a tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:21.789066 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c12e1742-819c-4fe7-8d39-5880271c0c6a tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:21.789586 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c12e1742-819c-4fe7-8d39-5880271c0c6a tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:21.817671 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=100 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:21.942962 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-c12e1742-819c-4fe7-8d39-5880271c0c6a tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e257ae4e744dd8a0553b7c2abee529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae18a142aa2049ffa07fc6516203f6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:21.950967 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-c12e1742-819c-4fe7-8d39-5880271c0c6a tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] 10.222.0.45 "GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9" status: 200 len: 1315 microversion: 2.1 time: 0.180910 Jun 03 09:57:21.951626 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 46/89] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:21 2022] GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:57:22.227249 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-5a51193c-4023-48e3-8cf4-2740a4e406a0 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:22.227922 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-5a51193c-4023-48e3-8cf4-2740a4e406a0 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:22.228141 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-8f4bd49a-d34f-4c52-9c6d-de3edc627ffe tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:22.228757 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-8f4bd49a-d34f-4c52-9c6d-de3edc627ffe tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:22.234154 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell0:SELECT=8 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:22.235228 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8f4bd49a-d34f-4c52-9c6d-de3edc627ffe tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:22.235664 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8f4bd49a-d34f-4c52-9c6d-de3edc627ffe tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:22.236453 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8f4bd49a-d34f-4c52-9c6d-de3edc627ffe tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:22.236597 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5a51193c-4023-48e3-8cf4-2740a4e406a0 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:22.236923 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8f4bd49a-d34f-4c52-9c6d-de3edc627ffe tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:22.237070 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5a51193c-4023-48e3-8cf4-2740a4e406a0 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:22.246913 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5a51193c-4023-48e3-8cf4-2740a4e406a0 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:22.247367 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5a51193c-4023-48e3-8cf4-2740a4e406a0 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:22.451712 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-8f4bd49a-d34f-4c52-9c6d-de3edc627ffe tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:22.459738 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-5a51193c-4023-48e3-8cf4-2740a4e406a0 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:22.461908 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-8f4bd49a-d34f-4c52-9c6d-de3edc627ffe tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1322 microversion: 2.1 time: 0.238973 Jun 03 09:57:22.473357 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 47/90] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:22 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1322 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:22.476111 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-5a51193c-4023-48e3-8cf4-2740a4e406a0 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:22.477382 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-5a51193c-4023-48e3-8cf4-2740a4e406a0 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:22.478690 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-5a51193c-4023-48e3-8cf4-2740a4e406a0 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1407 microversion: 2.20 time: 0.256904 Jun 03 09:57:22.480047 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 44/91] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 09:57:22 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1407 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:57:22.575680 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-a8de81cf-1eef-4051-b9f9-ee9bf8a4d078 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:22.576406 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-a8de81cf-1eef-4051-b9f9-ee9bf8a4d078 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:22.583236 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a8de81cf-1eef-4051-b9f9-ee9bf8a4d078 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:22.583827 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a8de81cf-1eef-4051-b9f9-ee9bf8a4d078 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:22.586971 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a8de81cf-1eef-4051-b9f9-ee9bf8a4d078 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:22.587513 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a8de81cf-1eef-4051-b9f9-ee9bf8a4d078 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:22.747803 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-a8de81cf-1eef-4051-b9f9-ee9bf8a4d078 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:22.756429 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-a8de81cf-1eef-4051-b9f9-ee9bf8a4d078 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e" status: 200 len: 1365 microversion: 2.1 time: 0.184491 Jun 03 09:57:22.757025 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 48/92] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:22 2022] GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e => generated 1365 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:22.834485 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-bcd46678-7493-470c-bb43-b0252d7eb76d req-c223aed7-0878-4e3d-9a02-91cc6a316cdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "489e83ce-4f5c-4a0c-a3c0-07379977a7b4", "name": "network-vif-plugged", "status": "completed", "tag": "d3dc5ae5-4b40-44f3-b52a-fe25f2c19221"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:57:22.843264 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-bcd46678-7493-470c-bb43-b0252d7eb76d req-c223aed7-0878-4e3d-9a02-91cc6a316cdd service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:22.843991 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-bcd46678-7493-470c-bb43-b0252d7eb76d req-c223aed7-0878-4e3d-9a02-91cc6a316cdd service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:22.857209 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-bcd46678-7493-470c-bb43-b0252d7eb76d req-c223aed7-0878-4e3d-9a02-91cc6a316cdd service nova] Creating event network-vif-plugged:d3dc5ae5-4b40-44f3-b52a-fe25f2c19221 for instance 489e83ce-4f5c-4a0c-a3c0-07379977a7b4 on hv-cinder-79760 Jun 03 09:57:22.863508 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-bcd46678-7493-470c-bb43-b0252d7eb76d req-c223aed7-0878-4e3d-9a02-91cc6a316cdd service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119025 Jun 03 09:57:22.865335 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 45/93] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 09:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 09:57:22.970853 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-c996bfc9-a230-499e-bce4-c6a16947d762 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:22.973108 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-c996bfc9-a230-499e-bce4-c6a16947d762 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] [instance: 85a66cd0-df20-4640-849b-73f7f01329b9] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:22.984518 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c996bfc9-a230-499e-bce4-c6a16947d762 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:22.990785 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c996bfc9-a230-499e-bce4-c6a16947d762 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:22.990785 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c996bfc9-a230-499e-bce4-c6a16947d762 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:22.990785 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c996bfc9-a230-499e-bce4-c6a16947d762 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:23.364141 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-c996bfc9-a230-499e-bce4-c6a16947d762 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e257ae4e744dd8a0553b7c2abee529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae18a142aa2049ffa07fc6516203f6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:23.397347 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-c996bfc9-a230-499e-bce4-c6a16947d762 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] 10.222.0.45 "GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9" status: 200 len: 1315 microversion: 2.1 time: 0.432014 Jun 03 09:57:23.398476 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 49/94] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:22 2022] GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9 => generated 1315 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:23.480844 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-cb746305-e22b-4c83-98c8-1e8462e58e1f tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:23.482503 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-cb746305-e22b-4c83-98c8-1e8462e58e1f tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:23.496926 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-709cb66e-e27d-4046-b9a7-c4490e113856 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:23.497876 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-709cb66e-e27d-4046-b9a7-c4490e113856 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:23.507016 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cb746305-e22b-4c83-98c8-1e8462e58e1f tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:23.509246 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cb746305-e22b-4c83-98c8-1e8462e58e1f tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:23.510981 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-709cb66e-e27d-4046-b9a7-c4490e113856 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:23.512749 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-709cb66e-e27d-4046-b9a7-c4490e113856 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:23.513048 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cb746305-e22b-4c83-98c8-1e8462e58e1f tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:23.513998 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cb746305-e22b-4c83-98c8-1e8462e58e1f tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:23.515120 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-709cb66e-e27d-4046-b9a7-c4490e113856 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:23.518446 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-709cb66e-e27d-4046-b9a7-c4490e113856 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:24.039269 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-cb746305-e22b-4c83-98c8-1e8462e58e1f tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:24.043131 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-709cb66e-e27d-4046-b9a7-c4490e113856 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:24.053770 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-709cb66e-e27d-4046-b9a7-c4490e113856 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:24.055161 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-cb746305-e22b-4c83-98c8-1e8462e58e1f tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1322 microversion: 2.1 time: 0.578982 Jun 03 09:57:24.056323 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 46/95] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:23 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1322 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:24.061397 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-a0f32a22-ddf6-4720-8aa1-decb24b2a0e1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:24.062383 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-a0f32a22-ddf6-4720-8aa1-decb24b2a0e1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:24.066911 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-709cb66e-e27d-4046-b9a7-c4490e113856 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:24.068166 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-709cb66e-e27d-4046-b9a7-c4490e113856 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1407 microversion: 2.20 time: 0.575232 Jun 03 09:57:24.069333 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 50/96] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 09:57:23 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1407 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:57:24.074560 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a0f32a22-ddf6-4720-8aa1-decb24b2a0e1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:24.075182 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a0f32a22-ddf6-4720-8aa1-decb24b2a0e1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:24.077327 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a0f32a22-ddf6-4720-8aa1-decb24b2a0e1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:24.077941 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a0f32a22-ddf6-4720-8aa1-decb24b2a0e1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:24.229132 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-a0f32a22-ddf6-4720-8aa1-decb24b2a0e1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:24.237049 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-a0f32a22-ddf6-4720-8aa1-decb24b2a0e1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e" status: 200 len: 1365 microversion: 2.1 time: 0.179468 Jun 03 09:57:24.237821 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 47/97] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:24 2022] GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:24.414915 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-a7a77059-50dd-426c-a10e-0a9489940dbb tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:24.415533 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-a7a77059-50dd-426c-a10e-0a9489940dbb tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] [instance: 85a66cd0-df20-4640-849b-73f7f01329b9] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:24.421853 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a7a77059-50dd-426c-a10e-0a9489940dbb tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:24.422946 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a7a77059-50dd-426c-a10e-0a9489940dbb tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:24.424000 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a7a77059-50dd-426c-a10e-0a9489940dbb tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:24.424147 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a7a77059-50dd-426c-a10e-0a9489940dbb tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:24.560193 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-a7a77059-50dd-426c-a10e-0a9489940dbb tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e257ae4e744dd8a0553b7c2abee529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae18a142aa2049ffa07fc6516203f6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:24.568290 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-a7a77059-50dd-426c-a10e-0a9489940dbb tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] 10.222.0.45 "GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9" status: 200 len: 1315 microversion: 2.1 time: 0.157180 Jun 03 09:57:24.568855 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 51/98] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:24 2022] GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:24.880244 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-0b1b343d-8b58-4f84-9678-9c098aabb6b6 req-086391f7-464f-463d-934e-9d489d7213f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85a66cd0-df20-4640-849b-73f7f01329b9", "name": "network-vif-plugged", "status": "completed", "tag": "736d00ec-ca8b-4f89-9a8a-c45962886815"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:57:24.890276 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-0b1b343d-8b58-4f84-9678-9c098aabb6b6 req-086391f7-464f-463d-934e-9d489d7213f7 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:24.891034 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-0b1b343d-8b58-4f84-9678-9c098aabb6b6 req-086391f7-464f-463d-934e-9d489d7213f7 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:24.902384 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-0b1b343d-8b58-4f84-9678-9c098aabb6b6 req-086391f7-464f-463d-934e-9d489d7213f7 service nova] Creating event network-vif-plugged:736d00ec-ca8b-4f89-9a8a-c45962886815 for instance 85a66cd0-df20-4640-849b-73f7f01329b9 on hv-cinder-79760 Jun 03 09:57:24.907888 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-0b1b343d-8b58-4f84-9678-9c098aabb6b6 req-086391f7-464f-463d-934e-9d489d7213f7 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031281 Jun 03 09:57:24.908479 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 48/99] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 09:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:57:25.073048 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-a0ed6490-5349-4857-87a6-302f43265e1c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:25.074329 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-a0ed6490-5349-4857-87a6-302f43265e1c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:25.085298 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a0ed6490-5349-4857-87a6-302f43265e1c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:25.085766 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a0ed6490-5349-4857-87a6-302f43265e1c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:25.086536 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a0ed6490-5349-4857-87a6-302f43265e1c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:25.087462 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a0ed6490-5349-4857-87a6-302f43265e1c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:25.089885 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-f4d69cd3-1499-443e-9174-1345d61dcbd3 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:25.091314 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-f4d69cd3-1499-443e-9174-1345d61dcbd3 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:25.103442 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f4d69cd3-1499-443e-9174-1345d61dcbd3 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:25.104133 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f4d69cd3-1499-443e-9174-1345d61dcbd3 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:25.105512 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f4d69cd3-1499-443e-9174-1345d61dcbd3 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:25.105987 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f4d69cd3-1499-443e-9174-1345d61dcbd3 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:25.381308 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f4d69cd3-1499-443e-9174-1345d61dcbd3 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:25.389882 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-a0ed6490-5349-4857-87a6-302f43265e1c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:25.390201 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f4d69cd3-1499-443e-9174-1345d61dcbd3 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:25.391902 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f4d69cd3-1499-443e-9174-1345d61dcbd3 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:25.393226 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-f4d69cd3-1499-443e-9174-1345d61dcbd3 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1407 microversion: 2.20 time: 0.309497 Jun 03 09:57:25.404188 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 49/100] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 09:57:25 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1407 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:57:25.404274 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-a0ed6490-5349-4857-87a6-302f43265e1c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1322 microversion: 2.1 time: 0.329983 Jun 03 09:57:25.404350 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-a6cb296f-62f2-4813-9b46-f644e61d0eb5 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:25.404350 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-a6cb296f-62f2-4813-9b46-f644e61d0eb5 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:25.407537 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 52/101] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:25 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1322 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:25.409823 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a6cb296f-62f2-4813-9b46-f644e61d0eb5 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:25.410319 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a6cb296f-62f2-4813-9b46-f644e61d0eb5 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:25.411224 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a6cb296f-62f2-4813-9b46-f644e61d0eb5 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:25.411669 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a6cb296f-62f2-4813-9b46-f644e61d0eb5 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:25.553353 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-a6cb296f-62f2-4813-9b46-f644e61d0eb5 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:25.560775 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-a6cb296f-62f2-4813-9b46-f644e61d0eb5 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e" status: 200 len: 1365 microversion: 2.1 time: 0.162386 Jun 03 09:57:25.561480 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 50/102] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:25 2022] GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:25.586080 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-1b3f0c93-86fb-4a3a-8bac-bdbfceba4d5a tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:25.586699 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-1b3f0c93-86fb-4a3a-8bac-bdbfceba4d5a tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] [instance: 85a66cd0-df20-4640-849b-73f7f01329b9] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:25.592691 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1b3f0c93-86fb-4a3a-8bac-bdbfceba4d5a tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:25.593083 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1b3f0c93-86fb-4a3a-8bac-bdbfceba4d5a tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:25.593888 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1b3f0c93-86fb-4a3a-8bac-bdbfceba4d5a tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:25.594345 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1b3f0c93-86fb-4a3a-8bac-bdbfceba4d5a tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:25.732637 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-1b3f0c93-86fb-4a3a-8bac-bdbfceba4d5a tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e257ae4e744dd8a0553b7c2abee529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae18a142aa2049ffa07fc6516203f6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:25.740834 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-1b3f0c93-86fb-4a3a-8bac-bdbfceba4d5a tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] 10.222.0.45 "GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9" status: 200 len: 1315 microversion: 2.1 time: 0.159150 Jun 03 09:57:25.741400 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 53/103] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:25 2022] GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:26.411802 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-ad363637-2e04-4958-aa05-cb37e26d95cb tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:26.412672 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-ad363637-2e04-4958-aa05-cb37e26d95cb tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:26.417186 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-67eb6c5b-d808-4ab3-8bf1-20761902e153 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:26.417990 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-67eb6c5b-d808-4ab3-8bf1-20761902e153 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:26.418924 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ad363637-2e04-4958-aa05-cb37e26d95cb tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:26.419461 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ad363637-2e04-4958-aa05-cb37e26d95cb tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:26.420235 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ad363637-2e04-4958-aa05-cb37e26d95cb tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:26.420675 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ad363637-2e04-4958-aa05-cb37e26d95cb tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:26.425148 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-67eb6c5b-d808-4ab3-8bf1-20761902e153 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:26.425590 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-67eb6c5b-d808-4ab3-8bf1-20761902e153 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:26.426536 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-67eb6c5b-d808-4ab3-8bf1-20761902e153 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:26.426970 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-67eb6c5b-d808-4ab3-8bf1-20761902e153 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:26.624811 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-ad363637-2e04-4958-aa05-cb37e26d95cb tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:26.628963 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-67eb6c5b-d808-4ab3-8bf1-20761902e153 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:26.633806 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-ad363637-2e04-4958-aa05-cb37e26d95cb tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:26.635439 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-ad363637-2e04-4958-aa05-cb37e26d95cb tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:26.636575 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-ad363637-2e04-4958-aa05-cb37e26d95cb tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1407 microversion: 2.20 time: 0.228798 Jun 03 09:57:26.636704 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-67eb6c5b-d808-4ab3-8bf1-20761902e153 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1322 microversion: 2.1 time: 0.224507 Jun 03 09:57:26.637097 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 51/104] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 09:57:26 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1407 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:57:26.649905 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 54/105] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:26 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:57:26.649905 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-e9401ca4-1f07-47db-a030-4e5a29c201e8 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:26.649905 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-e9401ca4-1f07-47db-a030-4e5a29c201e8 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:26.649905 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e9401ca4-1f07-47db-a030-4e5a29c201e8 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:26.650240 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e9401ca4-1f07-47db-a030-4e5a29c201e8 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:26.650240 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e9401ca4-1f07-47db-a030-4e5a29c201e8 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:26.650240 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e9401ca4-1f07-47db-a030-4e5a29c201e8 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:26.759301 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-eb247ec1-69e0-4913-825b-7454384e1956 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:26.760167 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-eb247ec1-69e0-4913-825b-7454384e1956 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] [instance: 85a66cd0-df20-4640-849b-73f7f01329b9] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:26.767017 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-eb247ec1-69e0-4913-825b-7454384e1956 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:26.767832 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-eb247ec1-69e0-4913-825b-7454384e1956 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:26.768961 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-eb247ec1-69e0-4913-825b-7454384e1956 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:26.769556 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-eb247ec1-69e0-4913-825b-7454384e1956 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:26.788508 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-e9401ca4-1f07-47db-a030-4e5a29c201e8 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:26.796807 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-e9401ca4-1f07-47db-a030-4e5a29c201e8 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e" status: 200 len: 1365 microversion: 2.1 time: 0.157876 Jun 03 09:57:26.799571 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 55/106] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:26 2022] GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:26.924984 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-eb247ec1-69e0-4913-825b-7454384e1956 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e257ae4e744dd8a0553b7c2abee529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae18a142aa2049ffa07fc6516203f6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:26.932610 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-eb247ec1-69e0-4913-825b-7454384e1956 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] 10.222.0.45 "GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9" status: 200 len: 1315 microversion: 2.1 time: 0.177628 Jun 03 09:57:26.933171 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 52/107] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:26 2022] GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:57:27.663849 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-ac938209-7323-4687-a398-c9be23027859 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:27.665132 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-ac938209-7323-4687-a398-c9be23027859 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:27.668152 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-ccdaa486-4d7c-4315-b28f-ef60bc9b23d3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:27.668767 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-ccdaa486-4d7c-4315-b28f-ef60bc9b23d3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:27.675034 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ac938209-7323-4687-a398-c9be23027859 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:27.675973 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ac938209-7323-4687-a398-c9be23027859 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:27.677189 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ac938209-7323-4687-a398-c9be23027859 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:27.677913 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ac938209-7323-4687-a398-c9be23027859 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:27.679581 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ccdaa486-4d7c-4315-b28f-ef60bc9b23d3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:27.680135 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ccdaa486-4d7c-4315-b28f-ef60bc9b23d3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:27.682654 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ccdaa486-4d7c-4315-b28f-ef60bc9b23d3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:27.684023 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ccdaa486-4d7c-4315-b28f-ef60bc9b23d3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:27.970397 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-ac938209-7323-4687-a398-c9be23027859 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:27.973654 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-ccdaa486-4d7c-4315-b28f-ef60bc9b23d3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:27.982876 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-ac938209-7323-4687-a398-c9be23027859 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:27.986644 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-ac938209-7323-4687-a398-c9be23027859 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:27.989113 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-ac938209-7323-4687-a398-c9be23027859 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1407 microversion: 2.20 time: 0.328936 Jun 03 09:57:27.993702 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-ccdaa486-4d7c-4315-b28f-ef60bc9b23d3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1322 microversion: 2.1 time: 0.322706 Jun 03 09:57:28.003182 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 53/108] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:27 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1322 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:28.003391 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 56/109] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 09:57:27 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1407 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:57:28.010757 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-be7eff49-9981-4532-a142-1bab5f1250d7 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:28.011396 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-be7eff49-9981-4532-a142-1bab5f1250d7 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:28.017033 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-cb169cc2-778b-4e2e-8f41-f5065519e991 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:28.017606 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-cb169cc2-778b-4e2e-8f41-f5065519e991 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] [instance: 85a66cd0-df20-4640-849b-73f7f01329b9] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:28.040437 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-be7eff49-9981-4532-a142-1bab5f1250d7 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:28.041821 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cb169cc2-778b-4e2e-8f41-f5065519e991 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:28.042298 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cb169cc2-778b-4e2e-8f41-f5065519e991 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:28.043363 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-be7eff49-9981-4532-a142-1bab5f1250d7 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:28.045965 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-be7eff49-9981-4532-a142-1bab5f1250d7 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:28.051479 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cb169cc2-778b-4e2e-8f41-f5065519e991 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:28.052282 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cb169cc2-778b-4e2e-8f41-f5065519e991 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:28.053822 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-be7eff49-9981-4532-a142-1bab5f1250d7 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:28.452032 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-be7eff49-9981-4532-a142-1bab5f1250d7 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:28.464909 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-be7eff49-9981-4532-a142-1bab5f1250d7 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e" status: 200 len: 1365 microversion: 2.1 time: 0.468727 Jun 03 09:57:28.466128 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 54/110] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:27 2022] GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e => generated 1365 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:28.475625 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-cb169cc2-778b-4e2e-8f41-f5065519e991 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e257ae4e744dd8a0553b7c2abee529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae18a142aa2049ffa07fc6516203f6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:28.484762 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-cb169cc2-778b-4e2e-8f41-f5065519e991 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] 10.222.0.45 "GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9" status: 200 len: 1315 microversion: 2.1 time: 0.484436 Jun 03 09:57:28.495317 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 57/111] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:27 2022] GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9 => generated 1315 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:29.008002 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-d107d106-d664-4191-b87f-80d4b3cf3587 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:29.008646 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-d107d106-d664-4191-b87f-80d4b3cf3587 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:29.010931 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-46045164-ed10-46aa-9ef8-930702a30c95 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:29.011599 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-46045164-ed10-46aa-9ef8-930702a30c95 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:29.014840 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d107d106-d664-4191-b87f-80d4b3cf3587 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:29.015277 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d107d106-d664-4191-b87f-80d4b3cf3587 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:29.016194 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d107d106-d664-4191-b87f-80d4b3cf3587 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:29.016630 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d107d106-d664-4191-b87f-80d4b3cf3587 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:29.019404 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-46045164-ed10-46aa-9ef8-930702a30c95 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:29.019862 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-46045164-ed10-46aa-9ef8-930702a30c95 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:29.021793 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-46045164-ed10-46aa-9ef8-930702a30c95 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:29.021793 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-46045164-ed10-46aa-9ef8-930702a30c95 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:29.237085 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-46045164-ed10-46aa-9ef8-930702a30c95 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:29.238724 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d107d106-d664-4191-b87f-80d4b3cf3587 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:29.241388 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell1:SELECT=100 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:29.244994 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-46045164-ed10-46aa-9ef8-930702a30c95 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1322 microversion: 2.1 time: 0.238044 Jun 03 09:57:29.245583 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 58/112] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:29 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:57:29.257583 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d107d106-d664-4191-b87f-80d4b3cf3587 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:29.259146 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d107d106-d664-4191-b87f-80d4b3cf3587 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:29.260270 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-d107d106-d664-4191-b87f-80d4b3cf3587 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1407 microversion: 2.20 time: 0.256204 Jun 03 09:57:29.270878 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 55/113] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 09:57:29 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1407 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:57:29.483820 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-daf265d6-b4c7-4219-96d2-e7aec22034bd tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:29.484524 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-daf265d6-b4c7-4219-96d2-e7aec22034bd tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:29.492851 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-daf265d6-b4c7-4219-96d2-e7aec22034bd tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:29.493352 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-daf265d6-b4c7-4219-96d2-e7aec22034bd tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:29.494316 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-daf265d6-b4c7-4219-96d2-e7aec22034bd tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:29.494743 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-daf265d6-b4c7-4219-96d2-e7aec22034bd tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:29.501928 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-9edb3ce5-4cad-4090-a34a-939e5af0a840 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:29.502476 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-9edb3ce5-4cad-4090-a34a-939e5af0a840 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] [instance: 85a66cd0-df20-4640-849b-73f7f01329b9] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:29.509358 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9edb3ce5-4cad-4090-a34a-939e5af0a840 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:29.510038 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9edb3ce5-4cad-4090-a34a-939e5af0a840 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:29.510923 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9edb3ce5-4cad-4090-a34a-939e5af0a840 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:29.511497 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9edb3ce5-4cad-4090-a34a-939e5af0a840 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:29.720464 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-daf265d6-b4c7-4219-96d2-e7aec22034bd tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:29.725722 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-9edb3ce5-4cad-4090-a34a-939e5af0a840 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e257ae4e744dd8a0553b7c2abee529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae18a142aa2049ffa07fc6516203f6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:29.729884 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-daf265d6-b4c7-4219-96d2-e7aec22034bd tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e" status: 200 len: 1365 microversion: 2.1 time: 0.251504 Jun 03 09:57:29.730726 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 59/114] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:29 2022] GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e => generated 1365 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:29.739288 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-9edb3ce5-4cad-4090-a34a-939e5af0a840 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] 10.222.0.45 "GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9" status: 200 len: 1315 microversion: 2.1 time: 0.235662 Jun 03 09:57:29.739288 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 56/115] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:29 2022] GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9 => generated 1315 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:57:30.056592 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-9ac94180-0042-4506-84aa-c12beb6c759b req-27e9504f-9ca3-489f-8ec5-c4ef25da6001 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59f3fa08-01f7-45d5-ae2b-171882dbc9c5", "name": "network-vif-plugged", "status": "completed", "tag": "fa8981dc-7a31-4c90-a538-73142807983c"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:57:30.068275 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-9ac94180-0042-4506-84aa-c12beb6c759b req-27e9504f-9ca3-489f-8ec5-c4ef25da6001 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:30.068715 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-9ac94180-0042-4506-84aa-c12beb6c759b req-27e9504f-9ca3-489f-8ec5-c4ef25da6001 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:30.081430 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-9ac94180-0042-4506-84aa-c12beb6c759b req-27e9504f-9ca3-489f-8ec5-c4ef25da6001 service nova] Creating event network-vif-plugged:fa8981dc-7a31-4c90-a538-73142807983c for instance 59f3fa08-01f7-45d5-ae2b-171882dbc9c5 on hv-cinder-79760 Jun 03 09:57:30.086951 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-9ac94180-0042-4506-84aa-c12beb6c759b req-27e9504f-9ca3-489f-8ec5-c4ef25da6001 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037447 Jun 03 09:57:30.087740 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 57/116] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 09:57:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:57:30.265028 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-8c79ca12-c79e-41b6-93dc-24fd2c8bb5ec tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:30.266299 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-8c79ca12-c79e-41b6-93dc-24fd2c8bb5ec tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:30.279035 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-e480eb28-c598-46bb-9966-a5115f3b3b9e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:30.280308 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-e480eb28-c598-46bb-9966-a5115f3b3b9e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:30.290203 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8c79ca12-c79e-41b6-93dc-24fd2c8bb5ec tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:30.293044 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8c79ca12-c79e-41b6-93dc-24fd2c8bb5ec tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:30.297294 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8c79ca12-c79e-41b6-93dc-24fd2c8bb5ec tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:30.299866 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8c79ca12-c79e-41b6-93dc-24fd2c8bb5ec tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:30.300219 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e480eb28-c598-46bb-9966-a5115f3b3b9e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:30.302674 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e480eb28-c598-46bb-9966-a5115f3b3b9e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:30.303585 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e480eb28-c598-46bb-9966-a5115f3b3b9e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:30.304142 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e480eb28-c598-46bb-9966-a5115f3b3b9e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:30.756831 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-8c79ca12-c79e-41b6-93dc-24fd2c8bb5ec tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:30.764451 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-8c79ca12-c79e-41b6-93dc-24fd2c8bb5ec tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1322 microversion: 2.1 time: 0.504039 Jun 03 09:57:30.765017 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 60/117] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:30 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1322 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:30.766401 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-e480eb28-c598-46bb-9966-a5115f3b3b9e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:30.775381 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-78e8c89c-b242-487b-86e9-13672e7ff9a6 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:30.775997 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-78e8c89c-b242-487b-86e9-13672e7ff9a6 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:30.787600 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-e480eb28-c598-46bb-9966-a5115f3b3b9e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:30.789694 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-e480eb28-c598-46bb-9966-a5115f3b3b9e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:30.795138 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-78e8c89c-b242-487b-86e9-13672e7ff9a6 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:30.795591 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-78e8c89c-b242-487b-86e9-13672e7ff9a6 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:30.796435 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-78e8c89c-b242-487b-86e9-13672e7ff9a6 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:30.797221 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-78e8c89c-b242-487b-86e9-13672e7ff9a6 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:30.802580 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-e480eb28-c598-46bb-9966-a5115f3b3b9e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1407 microversion: 2.20 time: 0.528282 Jun 03 09:57:30.803398 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 58/118] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 09:57:30 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1407 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:57:30.809362 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-7b52e1cd-781f-4069-ab0c-03418fb352ad tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:30.810181 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-7b52e1cd-781f-4069-ab0c-03418fb352ad tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] [instance: 85a66cd0-df20-4640-849b-73f7f01329b9] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:30.822662 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7b52e1cd-781f-4069-ab0c-03418fb352ad tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:30.823116 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7b52e1cd-781f-4069-ab0c-03418fb352ad tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:30.823926 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7b52e1cd-781f-4069-ab0c-03418fb352ad tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:30.826726 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7b52e1cd-781f-4069-ab0c-03418fb352ad tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:31.065739 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-78e8c89c-b242-487b-86e9-13672e7ff9a6 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:31.074453 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-78e8c89c-b242-487b-86e9-13672e7ff9a6 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e" status: 200 len: 1365 microversion: 2.1 time: 0.303919 Jun 03 09:57:31.084039 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 61/119] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:30 2022] GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e => generated 1365 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:31.086743 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-7b52e1cd-781f-4069-ab0c-03418fb352ad tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e257ae4e744dd8a0553b7c2abee529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae18a142aa2049ffa07fc6516203f6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:31.096312 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-7b52e1cd-781f-4069-ab0c-03418fb352ad tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] 10.222.0.45 "GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9" status: 200 len: 1315 microversion: 2.1 time: 0.291590 Jun 03 09:57:31.105848 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 59/120] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:30 2022] GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9 => generated 1315 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:31.781268 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-916b4c1f-d2fd-4dad-b6d6-66b8ed7a5d8c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:31.781963 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-916b4c1f-d2fd-4dad-b6d6-66b8ed7a5d8c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:31.788083 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-916b4c1f-d2fd-4dad-b6d6-66b8ed7a5d8c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:31.788565 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-916b4c1f-d2fd-4dad-b6d6-66b8ed7a5d8c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:31.789277 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-916b4c1f-d2fd-4dad-b6d6-66b8ed7a5d8c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:31.789714 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-916b4c1f-d2fd-4dad-b6d6-66b8ed7a5d8c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:31.822602 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-50ede4d1-6e31-44b9-99c0-ea91471e446e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:31.823073 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-50ede4d1-6e31-44b9-99c0-ea91471e446e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:31.829939 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-50ede4d1-6e31-44b9-99c0-ea91471e446e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:31.830479 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-50ede4d1-6e31-44b9-99c0-ea91471e446e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:31.831334 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-50ede4d1-6e31-44b9-99c0-ea91471e446e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:31.831776 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-50ede4d1-6e31-44b9-99c0-ea91471e446e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:31.983387 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-916b4c1f-d2fd-4dad-b6d6-66b8ed7a5d8c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:31.998254 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-916b4c1f-d2fd-4dad-b6d6-66b8ed7a5d8c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1516 microversion: 2.1 time: 0.221611 Jun 03 09:57:31.998834 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 62/121] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:31 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1516 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:32.014091 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-50ede4d1-6e31-44b9-99c0-ea91471e446e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:32.018014 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-0e8f414a-a7fb-42ac-8d23-2758c05f2e43 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:57:32.019155 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-0e8f414a-a7fb-42ac-8d23-2758c05f2e43 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:32.024465 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-50ede4d1-6e31-44b9-99c0-ea91471e446e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:32.025464 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0e8f414a-a7fb-42ac-8d23-2758c05f2e43 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:32.025956 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0e8f414a-a7fb-42ac-8d23-2758c05f2e43 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:32.026088 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-50ede4d1-6e31-44b9-99c0-ea91471e446e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:32.027005 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0e8f414a-a7fb-42ac-8d23-2758c05f2e43 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:32.027144 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-50ede4d1-6e31-44b9-99c0-ea91471e446e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1407 microversion: 2.20 time: 0.210237 Jun 03 09:57:32.027813 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0e8f414a-a7fb-42ac-8d23-2758c05f2e43 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:32.028946 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 60/122] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 09:57:31 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1407 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:57:32.066029 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=100 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:32.093448 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-eca76453-9789-484a-b1e5-6b8f2f7f307a tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:32.095248 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-eca76453-9789-484a-b1e5-6b8f2f7f307a tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:32.108749 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-eca76453-9789-484a-b1e5-6b8f2f7f307a tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:32.109389 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.objects.instance [None req-0e8f414a-a7fb-42ac-8d23-2758c05f2e43 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lazy-loading 'flavor' on Instance uuid 489e83ce-4f5c-4a0c-a3c0-07379977a7b4 {{(pid=117647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 09:57:32.109517 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-eca76453-9789-484a-b1e5-6b8f2f7f307a tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:32.110283 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-eca76453-9789-484a-b1e5-6b8f2f7f307a tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:32.110723 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-eca76453-9789-484a-b1e5-6b8f2f7f307a tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:32.293959 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-0e8f414a-a7fb-42ac-8d23-2758c05f2e43 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "POST /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4/action" status: 200 len: 32 microversion: 2.1 time: 0.280470 Jun 03 09:57:32.294936 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 63/123] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jun 3 09:57:32 2022] POST /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4/action => generated 32 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 09:57:32.309836 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-d38e89b4-efc2-4d8b-8609-0cf6e87a4f06 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:32.311237 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-d38e89b4-efc2-4d8b-8609-0cf6e87a4f06 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] [instance: 85a66cd0-df20-4640-849b-73f7f01329b9] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:32.322666 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d38e89b4-efc2-4d8b-8609-0cf6e87a4f06 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:32.323402 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d38e89b4-efc2-4d8b-8609-0cf6e87a4f06 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:32.324586 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d38e89b4-efc2-4d8b-8609-0cf6e87a4f06 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:32.325126 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d38e89b4-efc2-4d8b-8609-0cf6e87a4f06 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:32.338805 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-eca76453-9789-484a-b1e5-6b8f2f7f307a tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:32.347433 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-eca76453-9789-484a-b1e5-6b8f2f7f307a tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e" status: 200 len: 1365 microversion: 2.1 time: 0.259644 Jun 03 09:57:32.348526 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 61/124] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:32 2022] GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e => generated 1365 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:32.358723 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-f0bf56bf-0727-44fe-8fbf-5e3a2f284044 req-07bb6c9c-ae75-4ef1-b696-10d5819a428f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f", "name": "network-vif-plugged", "status": "completed", "tag": "d6b08e27-3091-4087-a29a-03ef6cbbdc0a"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:57:32.370111 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-f0bf56bf-0727-44fe-8fbf-5e3a2f284044 req-07bb6c9c-ae75-4ef1-b696-10d5819a428f service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:32.370743 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-f0bf56bf-0727-44fe-8fbf-5e3a2f284044 req-07bb6c9c-ae75-4ef1-b696-10d5819a428f service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:32.409622 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-f0bf56bf-0727-44fe-8fbf-5e3a2f284044 req-07bb6c9c-ae75-4ef1-b696-10d5819a428f service nova] Creating event network-vif-plugged:d6b08e27-3091-4087-a29a-03ef6cbbdc0a for instance 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f on hv-cinder-79760 Jun 03 09:57:32.415241 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-f0bf56bf-0727-44fe-8fbf-5e3a2f284044 req-07bb6c9c-ae75-4ef1-b696-10d5819a428f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065151 Jun 03 09:57:32.416196 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 62/125] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 09:57:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:57:32.423921 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-754969eb-abc5-4549-a12e-312d164942a9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:32.424709 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-754969eb-abc5-4549-a12e-312d164942a9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:32.432396 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-754969eb-abc5-4549-a12e-312d164942a9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:32.432981 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-754969eb-abc5-4549-a12e-312d164942a9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:32.433790 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-754969eb-abc5-4549-a12e-312d164942a9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:32.434422 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-754969eb-abc5-4549-a12e-312d164942a9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:32.587512 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-d38e89b4-efc2-4d8b-8609-0cf6e87a4f06 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e257ae4e744dd8a0553b7c2abee529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae18a142aa2049ffa07fc6516203f6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:32.597281 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-d38e89b4-efc2-4d8b-8609-0cf6e87a4f06 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] 10.222.0.45 "GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9" status: 200 len: 1503 microversion: 2.1 time: 0.295627 Jun 03 09:57:32.598090 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 64/126] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:32 2022] GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9 => generated 1503 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:32.618244 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-754969eb-abc5-4549-a12e-312d164942a9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:32.626230 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-754969eb-abc5-4549-a12e-312d164942a9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1522 microversion: 2.1 time: 0.208661 Jun 03 09:57:32.626803 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 63/127] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:32 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:33.047068 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-784dca8a-16ef-48e8-9f42-103a68e3618c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:33.048204 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-784dca8a-16ef-48e8-9f42-103a68e3618c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:33.054320 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-784dca8a-16ef-48e8-9f42-103a68e3618c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:33.054786 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-784dca8a-16ef-48e8-9f42-103a68e3618c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:33.055536 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-784dca8a-16ef-48e8-9f42-103a68e3618c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:33.055991 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-784dca8a-16ef-48e8-9f42-103a68e3618c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:33.185956 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-784dca8a-16ef-48e8-9f42-103a68e3618c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:33.193921 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-784dca8a-16ef-48e8-9f42-103a68e3618c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:33.195443 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-784dca8a-16ef-48e8-9f42-103a68e3618c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:33.196562 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-784dca8a-16ef-48e8-9f42-103a68e3618c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1407 microversion: 2.20 time: 0.153759 Jun 03 09:57:33.197126 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 65/128] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 09:57:33 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:57:33.364618 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-c56188cb-3b0b-4536-aa65-06c9f9ccfe2f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:33.365365 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-c56188cb-3b0b-4536-aa65-06c9f9ccfe2f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:33.371463 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c56188cb-3b0b-4536-aa65-06c9f9ccfe2f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:33.371918 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c56188cb-3b0b-4536-aa65-06c9f9ccfe2f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:33.372686 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c56188cb-3b0b-4536-aa65-06c9f9ccfe2f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:33.373236 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c56188cb-3b0b-4536-aa65-06c9f9ccfe2f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:33.518709 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-c56188cb-3b0b-4536-aa65-06c9f9ccfe2f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:33.526089 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-c56188cb-3b0b-4536-aa65-06c9f9ccfe2f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e" status: 200 len: 1365 microversion: 2.1 time: 0.165172 Jun 03 09:57:33.526657 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 64/129] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:33 2022] GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:33.642870 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-13fe1adb-e268-4034-a73a-28557c06a9dc tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:33.643402 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-13fe1adb-e268-4034-a73a-28557c06a9dc tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:33.651673 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-13fe1adb-e268-4034-a73a-28557c06a9dc tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:33.652139 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-13fe1adb-e268-4034-a73a-28557c06a9dc tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:33.652892 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-13fe1adb-e268-4034-a73a-28557c06a9dc tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:33.653317 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-13fe1adb-e268-4034-a73a-28557c06a9dc tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:33.784677 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-13fe1adb-e268-4034-a73a-28557c06a9dc tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:33.792448 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-13fe1adb-e268-4034-a73a-28557c06a9dc tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1522 microversion: 2.1 time: 0.153339 Jun 03 09:57:33.793013 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 66/130] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:33 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:34.214654 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-0ff79d62-cbbc-444b-a83e-7b5cb8bdada1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:34.215287 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-0ff79d62-cbbc-444b-a83e-7b5cb8bdada1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:34.221900 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0ff79d62-cbbc-444b-a83e-7b5cb8bdada1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:34.222339 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0ff79d62-cbbc-444b-a83e-7b5cb8bdada1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:34.223101 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0ff79d62-cbbc-444b-a83e-7b5cb8bdada1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:34.223562 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0ff79d62-cbbc-444b-a83e-7b5cb8bdada1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:34.349560 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-0ff79d62-cbbc-444b-a83e-7b5cb8bdada1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:34.357778 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-0ff79d62-cbbc-444b-a83e-7b5cb8bdada1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:34.359292 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-0ff79d62-cbbc-444b-a83e-7b5cb8bdada1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:34.360706 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-0ff79d62-cbbc-444b-a83e-7b5cb8bdada1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1407 microversion: 2.20 time: 0.149608 Jun 03 09:57:34.361275 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 65/131] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 09:57:34 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:57:34.542764 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-e7afdf9a-6cae-4d47-952a-0c2ef96dc956 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:34.543381 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-e7afdf9a-6cae-4d47-952a-0c2ef96dc956 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:34.549456 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e7afdf9a-6cae-4d47-952a-0c2ef96dc956 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:34.549967 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e7afdf9a-6cae-4d47-952a-0c2ef96dc956 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:34.550728 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e7afdf9a-6cae-4d47-952a-0c2ef96dc956 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:34.551188 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e7afdf9a-6cae-4d47-952a-0c2ef96dc956 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:34.681351 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-e7afdf9a-6cae-4d47-952a-0c2ef96dc956 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:34.689385 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-e7afdf9a-6cae-4d47-952a-0c2ef96dc956 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e" status: 200 len: 1365 microversion: 2.1 time: 0.150449 Jun 03 09:57:34.689990 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 67/132] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:34 2022] GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:57:34.808803 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-577f56b0-58e7-48ad-a56b-d614e9470e9e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:34.809441 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-577f56b0-58e7-48ad-a56b-d614e9470e9e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:34.816110 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-577f56b0-58e7-48ad-a56b-d614e9470e9e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:34.816589 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-577f56b0-58e7-48ad-a56b-d614e9470e9e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:34.817289 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-577f56b0-58e7-48ad-a56b-d614e9470e9e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:34.817716 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-577f56b0-58e7-48ad-a56b-d614e9470e9e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:34.948853 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-577f56b0-58e7-48ad-a56b-d614e9470e9e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:34.956296 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-577f56b0-58e7-48ad-a56b-d614e9470e9e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1522 microversion: 2.1 time: 0.151830 Jun 03 09:57:34.956890 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 66/133] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:34 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:35.377947 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-27c8e61a-d96d-4c5c-8bde-80cd32542037 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:35.378562 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-27c8e61a-d96d-4c5c-8bde-80cd32542037 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:35.384702 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-27c8e61a-d96d-4c5c-8bde-80cd32542037 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:35.385149 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-27c8e61a-d96d-4c5c-8bde-80cd32542037 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:35.385959 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-27c8e61a-d96d-4c5c-8bde-80cd32542037 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:35.386403 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-27c8e61a-d96d-4c5c-8bde-80cd32542037 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:35.513635 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-27c8e61a-d96d-4c5c-8bde-80cd32542037 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:35.522526 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-27c8e61a-d96d-4c5c-8bde-80cd32542037 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:35.524048 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-27c8e61a-d96d-4c5c-8bde-80cd32542037 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:35.525183 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-27c8e61a-d96d-4c5c-8bde-80cd32542037 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1407 microversion: 2.20 time: 0.151274 Jun 03 09:57:35.525741 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 68/134] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 09:57:35 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:57:35.706709 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-70664ce7-cf28-48d9-b43e-f36f39d40a5d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:35.707318 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-70664ce7-cf28-48d9-b43e-f36f39d40a5d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:35.709313 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:35.714508 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-70664ce7-cf28-48d9-b43e-f36f39d40a5d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:35.714947 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-70664ce7-cf28-48d9-b43e-f36f39d40a5d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:35.715696 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-70664ce7-cf28-48d9-b43e-f36f39d40a5d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:35.716124 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-70664ce7-cf28-48d9-b43e-f36f39d40a5d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:35.849019 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-70664ce7-cf28-48d9-b43e-f36f39d40a5d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:35.856417 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-70664ce7-cf28-48d9-b43e-f36f39d40a5d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e" status: 200 len: 1365 microversion: 2.1 time: 0.154010 Jun 03 09:57:35.857103 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 67/135] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:35 2022] GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:35.972540 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-64398141-dcc7-4c36-b24d-2d554de1e72a tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:35.973086 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-64398141-dcc7-4c36-b24d-2d554de1e72a tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:35.979206 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-64398141-dcc7-4c36-b24d-2d554de1e72a tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:35.979656 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-64398141-dcc7-4c36-b24d-2d554de1e72a tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:35.980421 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-64398141-dcc7-4c36-b24d-2d554de1e72a tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:35.980857 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-64398141-dcc7-4c36-b24d-2d554de1e72a tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:36.114521 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-64398141-dcc7-4c36-b24d-2d554de1e72a tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:36.121900 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-64398141-dcc7-4c36-b24d-2d554de1e72a tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1522 microversion: 2.1 time: 0.153221 Jun 03 09:57:36.122457 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 69/136] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:35 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:36.543278 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-965bed76-6c24-4c06-acdf-488337b4d1e3 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:36.543912 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-965bed76-6c24-4c06-acdf-488337b4d1e3 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:36.550518 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-965bed76-6c24-4c06-acdf-488337b4d1e3 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:36.550959 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-965bed76-6c24-4c06-acdf-488337b4d1e3 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:36.551825 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-965bed76-6c24-4c06-acdf-488337b4d1e3 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:36.552271 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-965bed76-6c24-4c06-acdf-488337b4d1e3 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:36.680552 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-965bed76-6c24-4c06-acdf-488337b4d1e3 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:36.688436 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-965bed76-6c24-4c06-acdf-488337b4d1e3 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:36.689994 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-965bed76-6c24-4c06-acdf-488337b4d1e3 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:36.691108 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-965bed76-6c24-4c06-acdf-488337b4d1e3 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1407 microversion: 2.20 time: 0.151644 Jun 03 09:57:36.691668 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 68/137] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 09:57:36 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:57:36.872589 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-db02cb79-cbe6-4ba4-bf7b-a71d7b07e84c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:36.873207 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-db02cb79-cbe6-4ba4-bf7b-a71d7b07e84c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:36.879502 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-db02cb79-cbe6-4ba4-bf7b-a71d7b07e84c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:36.879983 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-db02cb79-cbe6-4ba4-bf7b-a71d7b07e84c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:36.880755 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-db02cb79-cbe6-4ba4-bf7b-a71d7b07e84c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:36.881194 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-db02cb79-cbe6-4ba4-bf7b-a71d7b07e84c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:37.011856 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-db02cb79-cbe6-4ba4-bf7b-a71d7b07e84c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:37.019959 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-db02cb79-cbe6-4ba4-bf7b-a71d7b07e84c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e" status: 200 len: 1365 microversion: 2.1 time: 0.151399 Jun 03 09:57:37.020529 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 70/138] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:36 2022] GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:37.143251 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-a8f782dc-f9d0-4f86-a609-75eb62315301 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:37.143251 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-a8f782dc-f9d0-4f86-a609-75eb62315301 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:37.149634 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a8f782dc-f9d0-4f86-a609-75eb62315301 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:37.150355 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a8f782dc-f9d0-4f86-a609-75eb62315301 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:37.151140 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a8f782dc-f9d0-4f86-a609-75eb62315301 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:37.151573 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a8f782dc-f9d0-4f86-a609-75eb62315301 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:37.288302 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-a8f782dc-f9d0-4f86-a609-75eb62315301 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:37.295654 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-a8f782dc-f9d0-4f86-a609-75eb62315301 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1522 microversion: 2.1 time: 0.159698 Jun 03 09:57:37.296397 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 69/139] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:37 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:37.709204 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-bd9cf2a2-b709-4143-af34-ca9721ff13f2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:37.709849 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-bd9cf2a2-b709-4143-af34-ca9721ff13f2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:37.716004 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bd9cf2a2-b709-4143-af34-ca9721ff13f2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:37.716459 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bd9cf2a2-b709-4143-af34-ca9721ff13f2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:37.717222 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bd9cf2a2-b709-4143-af34-ca9721ff13f2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:37.717665 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bd9cf2a2-b709-4143-af34-ca9721ff13f2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:37.855712 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-bd9cf2a2-b709-4143-af34-ca9721ff13f2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:37.864136 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-bd9cf2a2-b709-4143-af34-ca9721ff13f2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:37.865634 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-bd9cf2a2-b709-4143-af34-ca9721ff13f2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:37.866764 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-bd9cf2a2-b709-4143-af34-ca9721ff13f2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1407 microversion: 2.20 time: 0.161416 Jun 03 09:57:37.867332 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 71/140] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 09:57:37 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:57:38.037256 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-37361116-0a60-4f08-a9e9-c3395617c5a9 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:38.037840 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-37361116-0a60-4f08-a9e9-c3395617c5a9 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:38.043935 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-37361116-0a60-4f08-a9e9-c3395617c5a9 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:38.044381 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-37361116-0a60-4f08-a9e9-c3395617c5a9 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:38.045137 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-37361116-0a60-4f08-a9e9-c3395617c5a9 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:38.045570 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-37361116-0a60-4f08-a9e9-c3395617c5a9 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:38.171811 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-37361116-0a60-4f08-a9e9-c3395617c5a9 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:38.179800 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-37361116-0a60-4f08-a9e9-c3395617c5a9 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e" status: 200 len: 1365 microversion: 2.1 time: 0.146467 Jun 03 09:57:38.180361 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 70/141] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:38 2022] GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:57:38.311998 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-64b8d8ea-dd30-4ae3-857c-a5e74aaf5225 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:38.312589 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-64b8d8ea-dd30-4ae3-857c-a5e74aaf5225 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:38.318463 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-64b8d8ea-dd30-4ae3-857c-a5e74aaf5225 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:38.318910 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-64b8d8ea-dd30-4ae3-857c-a5e74aaf5225 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:38.319663 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-64b8d8ea-dd30-4ae3-857c-a5e74aaf5225 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:38.323826 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-64b8d8ea-dd30-4ae3-857c-a5e74aaf5225 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:38.459936 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-64b8d8ea-dd30-4ae3-857c-a5e74aaf5225 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:38.467245 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-64b8d8ea-dd30-4ae3-857c-a5e74aaf5225 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1522 microversion: 2.1 time: 0.159065 Jun 03 09:57:38.467811 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 72/142] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:38 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:38.885324 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-b90c69bb-4354-47b0-ae6d-7101ef98f1a8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:38.888143 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-b90c69bb-4354-47b0-ae6d-7101ef98f1a8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:38.896620 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b90c69bb-4354-47b0-ae6d-7101ef98f1a8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:38.897068 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b90c69bb-4354-47b0-ae6d-7101ef98f1a8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:38.897943 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b90c69bb-4354-47b0-ae6d-7101ef98f1a8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:38.898409 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b90c69bb-4354-47b0-ae6d-7101ef98f1a8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:39.037986 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-b90c69bb-4354-47b0-ae6d-7101ef98f1a8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:39.048636 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-b90c69bb-4354-47b0-ae6d-7101ef98f1a8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:39.050720 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-b90c69bb-4354-47b0-ae6d-7101ef98f1a8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:39.051843 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-b90c69bb-4354-47b0-ae6d-7101ef98f1a8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1407 microversion: 2.20 time: 0.171373 Jun 03 09:57:39.052414 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 71/143] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 09:57:38 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:57:39.196188 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-67a2f654-ae5a-416f-a644-c75a62a78e68 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:39.196806 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-67a2f654-ae5a-416f-a644-c75a62a78e68 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:39.202988 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-67a2f654-ae5a-416f-a644-c75a62a78e68 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:39.203440 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-67a2f654-ae5a-416f-a644-c75a62a78e68 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:39.204202 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-67a2f654-ae5a-416f-a644-c75a62a78e68 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:39.204641 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-67a2f654-ae5a-416f-a644-c75a62a78e68 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:39.349773 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-67a2f654-ae5a-416f-a644-c75a62a78e68 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:39.367082 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-67a2f654-ae5a-416f-a644-c75a62a78e68 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e" status: 200 len: 1365 microversion: 2.1 time: 0.174431 Jun 03 09:57:39.368454 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 73/144] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:39 2022] GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:39.484516 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-aba1cf39-f698-46ba-8319-ee2830d03cfc tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:39.485111 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-aba1cf39-f698-46ba-8319-ee2830d03cfc tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:39.493394 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-aba1cf39-f698-46ba-8319-ee2830d03cfc tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:39.493886 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-aba1cf39-f698-46ba-8319-ee2830d03cfc tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:39.494796 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-aba1cf39-f698-46ba-8319-ee2830d03cfc tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:39.495244 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-aba1cf39-f698-46ba-8319-ee2830d03cfc tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:39.634200 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-aba1cf39-f698-46ba-8319-ee2830d03cfc tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:39.641896 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-aba1cf39-f698-46ba-8319-ee2830d03cfc tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1522 microversion: 2.1 time: 0.161271 Jun 03 09:57:39.642527 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 72/145] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:39 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:40.070458 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-30d1cc23-dbc6-41b9-b79a-e48829a6fffa tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:40.071016 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-30d1cc23-dbc6-41b9-b79a-e48829a6fffa tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:40.077179 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-30d1cc23-dbc6-41b9-b79a-e48829a6fffa tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:40.077632 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-30d1cc23-dbc6-41b9-b79a-e48829a6fffa tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:40.078430 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-30d1cc23-dbc6-41b9-b79a-e48829a6fffa tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:40.078891 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-30d1cc23-dbc6-41b9-b79a-e48829a6fffa tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:40.213238 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-30d1cc23-dbc6-41b9-b79a-e48829a6fffa tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:40.222211 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-30d1cc23-dbc6-41b9-b79a-e48829a6fffa tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:40.223756 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-30d1cc23-dbc6-41b9-b79a-e48829a6fffa tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:40.224914 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-30d1cc23-dbc6-41b9-b79a-e48829a6fffa tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1407 microversion: 2.20 time: 0.158507 Jun 03 09:57:40.225496 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 74/146] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 09:57:40 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:57:40.386378 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-56919a46-c90e-4c2b-90ba-c9dd1f9a6ec3 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:40.387004 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-56919a46-c90e-4c2b-90ba-c9dd1f9a6ec3 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:40.395612 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-56919a46-c90e-4c2b-90ba-c9dd1f9a6ec3 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:40.395612 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-56919a46-c90e-4c2b-90ba-c9dd1f9a6ec3 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:40.395612 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-56919a46-c90e-4c2b-90ba-c9dd1f9a6ec3 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:40.395612 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-56919a46-c90e-4c2b-90ba-c9dd1f9a6ec3 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:40.531415 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-56919a46-c90e-4c2b-90ba-c9dd1f9a6ec3 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:40.534123 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell1:SELECT=100 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:40.540297 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-56919a46-c90e-4c2b-90ba-c9dd1f9a6ec3 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e" status: 200 len: 1365 microversion: 2.1 time: 0.157665 Jun 03 09:57:40.540860 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 73/147] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:40 2022] GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:40.662932 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-44584a5d-2d75-4f01-b7e0-54bf62aff1ee tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:40.663691 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-44584a5d-2d75-4f01-b7e0-54bf62aff1ee tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:40.672004 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-44584a5d-2d75-4f01-b7e0-54bf62aff1ee tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:40.672458 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-44584a5d-2d75-4f01-b7e0-54bf62aff1ee tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:40.673878 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-44584a5d-2d75-4f01-b7e0-54bf62aff1ee tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:40.675904 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-44584a5d-2d75-4f01-b7e0-54bf62aff1ee tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:40.853501 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-44584a5d-2d75-4f01-b7e0-54bf62aff1ee tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:40.861012 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-44584a5d-2d75-4f01-b7e0-54bf62aff1ee tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1522 microversion: 2.1 time: 0.204942 Jun 03 09:57:40.861578 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 75/148] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:40 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:41.242761 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-e404fa07-0a60-441c-950e-2c1ff52e8154 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:41.243430 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-e404fa07-0a60-441c-950e-2c1ff52e8154 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:41.249403 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e404fa07-0a60-441c-950e-2c1ff52e8154 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:41.249880 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e404fa07-0a60-441c-950e-2c1ff52e8154 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:41.250637 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e404fa07-0a60-441c-950e-2c1ff52e8154 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:41.251614 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e404fa07-0a60-441c-950e-2c1ff52e8154 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:41.419446 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-e404fa07-0a60-441c-950e-2c1ff52e8154 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:41.430769 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-e404fa07-0a60-441c-950e-2c1ff52e8154 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:41.431375 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-e404fa07-0a60-441c-950e-2c1ff52e8154 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:41.432515 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-e404fa07-0a60-441c-950e-2c1ff52e8154 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1407 microversion: 2.20 time: 0.193857 Jun 03 09:57:41.433076 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 74/149] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 09:57:41 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:57:41.558199 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-619c5634-0b73-4529-9e8f-4cd9b38b5f1c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:41.558847 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-619c5634-0b73-4529-9e8f-4cd9b38b5f1c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:41.560975 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_api:SELECT=90 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:41.567271 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-619c5634-0b73-4529-9e8f-4cd9b38b5f1c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:41.567765 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-619c5634-0b73-4529-9e8f-4cd9b38b5f1c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:41.568663 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-619c5634-0b73-4529-9e8f-4cd9b38b5f1c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:41.569162 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-619c5634-0b73-4529-9e8f-4cd9b38b5f1c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:41.706117 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-619c5634-0b73-4529-9e8f-4cd9b38b5f1c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:41.715992 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-619c5634-0b73-4529-9e8f-4cd9b38b5f1c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e" status: 200 len: 1365 microversion: 2.1 time: 0.162216 Jun 03 09:57:41.716744 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 76/150] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:41 2022] GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:41.833555 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-717aa31b-3a89-4ac5-b343-2bd772d3670f req-61c6b643-c0d8-4db3-98d9-2d96b62ee96d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e", "name": "network-vif-plugged", "status": "completed", "tag": "9ce3fd34-d579-4eda-8b0a-3d97ea2da07d"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:57:41.846056 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-717aa31b-3a89-4ac5-b343-2bd772d3670f req-61c6b643-c0d8-4db3-98d9-2d96b62ee96d service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:41.847027 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-717aa31b-3a89-4ac5-b343-2bd772d3670f req-61c6b643-c0d8-4db3-98d9-2d96b62ee96d service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:41.859946 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-717aa31b-3a89-4ac5-b343-2bd772d3670f req-61c6b643-c0d8-4db3-98d9-2d96b62ee96d service nova] Creating event network-vif-plugged:9ce3fd34-d579-4eda-8b0a-3d97ea2da07d for instance 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e on hv-cinder-79760 Jun 03 09:57:41.866266 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-717aa31b-3a89-4ac5-b343-2bd772d3670f req-61c6b643-c0d8-4db3-98d9-2d96b62ee96d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042527 Jun 03 09:57:41.867382 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 75/151] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 09:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:57:41.879215 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-45d508f6-3827-4eb9-9f91-aefa18236d5f tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:41.879997 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-45d508f6-3827-4eb9-9f91-aefa18236d5f tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:41.888467 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-45d508f6-3827-4eb9-9f91-aefa18236d5f tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:41.889008 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-45d508f6-3827-4eb9-9f91-aefa18236d5f tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:41.889912 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-45d508f6-3827-4eb9-9f91-aefa18236d5f tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:41.890422 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-45d508f6-3827-4eb9-9f91-aefa18236d5f tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:42.030449 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-45d508f6-3827-4eb9-9f91-aefa18236d5f tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:42.036901 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:42.044671 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-45d508f6-3827-4eb9-9f91-aefa18236d5f tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1522 microversion: 2.1 time: 0.170258 Jun 03 09:57:42.045257 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 77/152] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:41 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:42.379143 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-24dd7ed7-1f9a-45a5-bf2a-9e34b65e63bb tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b5fdf910-8bcc-4322-a561-b71eb4d39d8f"}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:57:42.380163 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-24dd7ed7-1f9a-45a5-bf2a-9e34b65e63bb tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] [instance: 85a66cd0-df20-4640-849b-73f7f01329b9] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:42.386451 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-24dd7ed7-1f9a-45a5-bf2a-9e34b65e63bb tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:42.387190 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-24dd7ed7-1f9a-45a5-bf2a-9e34b65e63bb tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:42.387971 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-24dd7ed7-1f9a-45a5-bf2a-9e34b65e63bb tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:42.388395 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-24dd7ed7-1f9a-45a5-bf2a-9e34b65e63bb tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:42.452174 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-2e9cd257-f51f-4a54-9cda-8812f1ec4da2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:42.452681 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-2e9cd257-f51f-4a54-9cda-8812f1ec4da2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:42.465479 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2e9cd257-f51f-4a54-9cda-8812f1ec4da2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:42.466155 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2e9cd257-f51f-4a54-9cda-8812f1ec4da2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:42.467123 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2e9cd257-f51f-4a54-9cda-8812f1ec4da2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:42.467560 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2e9cd257-f51f-4a54-9cda-8812f1ec4da2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:42.630592 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-2e9cd257-f51f-4a54-9cda-8812f1ec4da2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:42.642141 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-2e9cd257-f51f-4a54-9cda-8812f1ec4da2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:42.643649 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-2e9cd257-f51f-4a54-9cda-8812f1ec4da2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:42.645265 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-2e9cd257-f51f-4a54-9cda-8812f1ec4da2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1407 microversion: 2.20 time: 0.198211 Jun 03 09:57:42.646011 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 78/153] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 09:57:42 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:57:42.733211 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-a23b53f1-ae62-4817-a8be-e29e795b015b tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:42.733831 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-a23b53f1-ae62-4817-a8be-e29e795b015b tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:42.739882 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a23b53f1-ae62-4817-a8be-e29e795b015b tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:42.740325 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a23b53f1-ae62-4817-a8be-e29e795b015b tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:42.741087 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a23b53f1-ae62-4817-a8be-e29e795b015b tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:42.741523 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a23b53f1-ae62-4817-a8be-e29e795b015b tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:42.879754 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-a23b53f1-ae62-4817-a8be-e29e795b015b tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:42.887348 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-a23b53f1-ae62-4817-a8be-e29e795b015b tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e" status: 200 len: 1365 microversion: 2.1 time: 0.157891 Jun 03 09:57:42.887959 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 79/154] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:42 2022] GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:57:43.062839 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-0150bbf5-9688-4ea8-a090-a0512d86ecd5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:43.063528 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-0150bbf5-9688-4ea8-a090-a0512d86ecd5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:43.070792 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0150bbf5-9688-4ea8-a090-a0512d86ecd5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:43.071457 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0150bbf5-9688-4ea8-a090-a0512d86ecd5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:43.072249 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0150bbf5-9688-4ea8-a090-a0512d86ecd5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:43.072684 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0150bbf5-9688-4ea8-a090-a0512d86ecd5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:43.224965 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-0150bbf5-9688-4ea8-a090-a0512d86ecd5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:43.233223 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-0150bbf5-9688-4ea8-a090-a0512d86ecd5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1522 microversion: 2.1 time: 0.174694 Jun 03 09:57:43.233965 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 80/155] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:43 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:57:43.664047 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-6e75be0c-08c3-4c92-9157-0bc6c47ed2bd tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:43.664659 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-6e75be0c-08c3-4c92-9157-0bc6c47ed2bd tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:43.670712 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6e75be0c-08c3-4c92-9157-0bc6c47ed2bd tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:43.671155 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6e75be0c-08c3-4c92-9157-0bc6c47ed2bd tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:43.671915 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6e75be0c-08c3-4c92-9157-0bc6c47ed2bd tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:43.672346 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6e75be0c-08c3-4c92-9157-0bc6c47ed2bd tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:43.808334 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-6e75be0c-08c3-4c92-9157-0bc6c47ed2bd tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:43.816783 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-6e75be0c-08c3-4c92-9157-0bc6c47ed2bd tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:43.818329 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-6e75be0c-08c3-4c92-9157-0bc6c47ed2bd tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:43.819438 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-6e75be0c-08c3-4c92-9157-0bc6c47ed2bd tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1407 microversion: 2.20 time: 0.159214 Jun 03 09:57:43.819994 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 81/156] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 09:57:43 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:57:43.903905 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-34a67e72-a717-4494-bae6-78969ab976be tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:43.904615 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-34a67e72-a717-4494-bae6-78969ab976be tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:43.911059 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-34a67e72-a717-4494-bae6-78969ab976be tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:43.911444 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-34a67e72-a717-4494-bae6-78969ab976be tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:43.912228 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-34a67e72-a717-4494-bae6-78969ab976be tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:43.912658 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-34a67e72-a717-4494-bae6-78969ab976be tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:44.037944 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-34a67e72-a717-4494-bae6-78969ab976be tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:44.045261 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-34a67e72-a717-4494-bae6-78969ab976be tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e" status: 200 len: 1365 microversion: 2.1 time: 0.145164 Jun 03 09:57:44.045848 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 82/157] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:43 2022] GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e => generated 1365 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:57:44.249328 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-7c2fb09d-2cd7-4cd4-9dff-8f50cf5714e9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:44.249997 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-7c2fb09d-2cd7-4cd4-9dff-8f50cf5714e9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:44.255981 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7c2fb09d-2cd7-4cd4-9dff-8f50cf5714e9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:44.256434 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7c2fb09d-2cd7-4cd4-9dff-8f50cf5714e9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:44.257192 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7c2fb09d-2cd7-4cd4-9dff-8f50cf5714e9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:44.257626 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7c2fb09d-2cd7-4cd4-9dff-8f50cf5714e9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:44.385710 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-7c2fb09d-2cd7-4cd4-9dff-8f50cf5714e9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:44.393310 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-7c2fb09d-2cd7-4cd4-9dff-8f50cf5714e9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1522 microversion: 2.1 time: 0.147782 Jun 03 09:57:44.393897 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 83/158] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:44 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:57:44.836856 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-e1796526-7ac3-41e7-bd3b-4bd631b86383 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:44.837473 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-e1796526-7ac3-41e7-bd3b-4bd631b86383 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:44.843542 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e1796526-7ac3-41e7-bd3b-4bd631b86383 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:44.843988 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e1796526-7ac3-41e7-bd3b-4bd631b86383 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:44.845234 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e1796526-7ac3-41e7-bd3b-4bd631b86383 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:44.845667 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e1796526-7ac3-41e7-bd3b-4bd631b86383 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:44.978732 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-e1796526-7ac3-41e7-bd3b-4bd631b86383 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:44.987580 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-e1796526-7ac3-41e7-bd3b-4bd631b86383 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:44.989113 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-e1796526-7ac3-41e7-bd3b-4bd631b86383 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:44.990264 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-e1796526-7ac3-41e7-bd3b-4bd631b86383 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1407 microversion: 2.20 time: 0.157224 Jun 03 09:57:44.990820 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 84/159] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 09:57:44 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:57:45.061724 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-cc2ade9c-efe8-40f2-9343-00b23ca5793d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:45.062352 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-cc2ade9c-efe8-40f2-9343-00b23ca5793d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:45.068419 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cc2ade9c-efe8-40f2-9343-00b23ca5793d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:45.068871 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cc2ade9c-efe8-40f2-9343-00b23ca5793d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:45.069622 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cc2ade9c-efe8-40f2-9343-00b23ca5793d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:45.070096 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cc2ade9c-efe8-40f2-9343-00b23ca5793d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:45.195870 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-cc2ade9c-efe8-40f2-9343-00b23ca5793d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:45.203305 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-cc2ade9c-efe8-40f2-9343-00b23ca5793d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e" status: 200 len: 1365 microversion: 2.1 time: 0.145200 Jun 03 09:57:45.203867 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 85/160] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:45 2022] GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e => generated 1365 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:57:45.410911 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-10da145f-1478-4929-9e26-32a8893dd44d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:45.411556 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-10da145f-1478-4929-9e26-32a8893dd44d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:45.417639 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-10da145f-1478-4929-9e26-32a8893dd44d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:45.418125 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-10da145f-1478-4929-9e26-32a8893dd44d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:45.418881 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-10da145f-1478-4929-9e26-32a8893dd44d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:45.419315 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-10da145f-1478-4929-9e26-32a8893dd44d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:45.547000 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-10da145f-1478-4929-9e26-32a8893dd44d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:45.555039 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-10da145f-1478-4929-9e26-32a8893dd44d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1522 microversion: 2.1 time: 0.148488 Jun 03 09:57:45.555604 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 86/161] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:45 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:57:46.008299 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-ebd6f53a-2b0f-4de0-956e-240808e719dc tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:46.008948 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-ebd6f53a-2b0f-4de0-956e-240808e719dc tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:46.015156 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ebd6f53a-2b0f-4de0-956e-240808e719dc tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:46.015608 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ebd6f53a-2b0f-4de0-956e-240808e719dc tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:46.016863 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ebd6f53a-2b0f-4de0-956e-240808e719dc tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:46.017310 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ebd6f53a-2b0f-4de0-956e-240808e719dc tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:46.143148 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-ebd6f53a-2b0f-4de0-956e-240808e719dc tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:46.151082 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-ebd6f53a-2b0f-4de0-956e-240808e719dc tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:46.152604 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-ebd6f53a-2b0f-4de0-956e-240808e719dc tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:46.153713 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-ebd6f53a-2b0f-4de0-956e-240808e719dc tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1407 microversion: 2.20 time: 0.149367 Jun 03 09:57:46.154290 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 87/162] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 09:57:46 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:57:46.220487 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-4ba0f080-71eb-4071-b90d-17ac327469b4 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:46.221375 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-4ba0f080-71eb-4071-b90d-17ac327469b4 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:46.227549 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4ba0f080-71eb-4071-b90d-17ac327469b4 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:46.228000 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4ba0f080-71eb-4071-b90d-17ac327469b4 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:46.228760 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4ba0f080-71eb-4071-b90d-17ac327469b4 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:46.229417 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4ba0f080-71eb-4071-b90d-17ac327469b4 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:46.364579 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-4ba0f080-71eb-4071-b90d-17ac327469b4 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:46.371932 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-4ba0f080-71eb-4071-b90d-17ac327469b4 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e" status: 200 len: 1365 microversion: 2.1 time: 0.155785 Jun 03 09:57:46.372487 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 88/163] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:46 2022] GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:57:46.571503 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-9dbc7c47-d989-4eca-ac88-4ce29385d211 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:46.572034 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-9dbc7c47-d989-4eca-ac88-4ce29385d211 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:46.577945 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9dbc7c47-d989-4eca-ac88-4ce29385d211 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:46.578391 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9dbc7c47-d989-4eca-ac88-4ce29385d211 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:46.579271 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9dbc7c47-d989-4eca-ac88-4ce29385d211 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:46.579707 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9dbc7c47-d989-4eca-ac88-4ce29385d211 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:46.712728 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-9dbc7c47-d989-4eca-ac88-4ce29385d211 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:46.720860 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-9dbc7c47-d989-4eca-ac88-4ce29385d211 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1522 microversion: 2.1 time: 0.153307 Jun 03 09:57:46.721425 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 89/164] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:46 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:57:47.172528 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-13143879-f33b-4f06-83cd-29802dfb271b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:47.173125 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-13143879-f33b-4f06-83cd-29802dfb271b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:47.179236 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-13143879-f33b-4f06-83cd-29802dfb271b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:47.179683 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-13143879-f33b-4f06-83cd-29802dfb271b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:47.180437 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-13143879-f33b-4f06-83cd-29802dfb271b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:47.180869 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-13143879-f33b-4f06-83cd-29802dfb271b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:47.309556 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-13143879-f33b-4f06-83cd-29802dfb271b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:47.318334 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-13143879-f33b-4f06-83cd-29802dfb271b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:47.319847 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-13143879-f33b-4f06-83cd-29802dfb271b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:47.321017 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-13143879-f33b-4f06-83cd-29802dfb271b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1599 microversion: 2.20 time: 0.152483 Jun 03 09:57:47.321578 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 90/165] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 09:57:47 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1599 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:57:47.345200 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-b720b024-4225-43b9-92a8-b20b46246a71 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:47.345698 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-b720b024-4225-43b9-92a8-b20b46246a71 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:47.351790 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b720b024-4225-43b9-92a8-b20b46246a71 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:47.352234 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b720b024-4225-43b9-92a8-b20b46246a71 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:47.352998 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b720b024-4225-43b9-92a8-b20b46246a71 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:47.353429 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b720b024-4225-43b9-92a8-b20b46246a71 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:47.448081 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-b720b024-4225-43b9-92a8-b20b46246a71 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.106626 Jun 03 09:57:47.448753 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 91/166] 10.222.0.45 () {60 vars in 1315 bytes} [Fri Jun 3 09:57:47 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 09:57:47.459153 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-eb52182a-bc6f-4c97-a845-94c6a267e08d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:47.459835 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-eb52182a-bc6f-4c97-a845-94c6a267e08d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:47.466026 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-eb52182a-bc6f-4c97-a845-94c6a267e08d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:47.466645 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-eb52182a-bc6f-4c97-a845-94c6a267e08d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:47.467564 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-eb52182a-bc6f-4c97-a845-94c6a267e08d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:47.468343 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-eb52182a-bc6f-4c97-a845-94c6a267e08d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:47.623512 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-eb52182a-bc6f-4c97-a845-94c6a267e08d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:47.631814 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-eb52182a-bc6f-4c97-a845-94c6a267e08d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e" status: 200 len: 1365 microversion: 2.1 time: 0.176339 Jun 03 09:57:47.632430 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 92/167] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:47 2022] GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e => generated 1365 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:47.737710 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-4d5badcb-02c6-441e-ad0c-2b9b97791789 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:47.742524 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-4d5badcb-02c6-441e-ad0c-2b9b97791789 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:47.750124 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4d5badcb-02c6-441e-ad0c-2b9b97791789 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:47.750601 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4d5badcb-02c6-441e-ad0c-2b9b97791789 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:47.753647 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4d5badcb-02c6-441e-ad0c-2b9b97791789 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:47.754747 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4d5badcb-02c6-441e-ad0c-2b9b97791789 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:47.912530 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-4d5badcb-02c6-441e-ad0c-2b9b97791789 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:47.931525 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-4d5badcb-02c6-441e-ad0c-2b9b97791789 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1522 microversion: 2.1 time: 0.198016 Jun 03 09:57:47.933348 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 93/168] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:47 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:57:48.650115 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-ae949d92-abaf-48ae-a80b-844a976ed12d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:48.651692 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-ae949d92-abaf-48ae-a80b-844a976ed12d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:48.668564 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ae949d92-abaf-48ae-a80b-844a976ed12d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:48.669937 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ae949d92-abaf-48ae-a80b-844a976ed12d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:48.673518 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ae949d92-abaf-48ae-a80b-844a976ed12d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:48.675058 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ae949d92-abaf-48ae-a80b-844a976ed12d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:48.929075 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-ae949d92-abaf-48ae-a80b-844a976ed12d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:48.935612 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=100 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:48.948316 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-ae949d92-abaf-48ae-a80b-844a976ed12d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e" status: 200 len: 1365 microversion: 2.1 time: 0.303053 Jun 03 09:57:48.957773 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 94/169] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:48 2022] GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e => generated 1365 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:57:48.970892 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-02fe591c-ae1c-424c-8529-175a327a5654 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:48.971517 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-02fe591c-ae1c-424c-8529-175a327a5654 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:48.993557 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-02fe591c-ae1c-424c-8529-175a327a5654 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:48.994211 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-02fe591c-ae1c-424c-8529-175a327a5654 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:49.006493 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-02fe591c-ae1c-424c-8529-175a327a5654 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:49.007000 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-02fe591c-ae1c-424c-8529-175a327a5654 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:49.241612 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-02fe591c-ae1c-424c-8529-175a327a5654 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:49.263077 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-02fe591c-ae1c-424c-8529-175a327a5654 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1522 microversion: 2.1 time: 0.312889 Jun 03 09:57:49.263966 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 95/170] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:48 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1522 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:49.269504 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-61b70c51-fbce-4745-a7a0-6337fb81326f req-e8b482bf-22bd-4928-a906-f840c3950be9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f", "tag": "d6b08e27-3091-4087-a29a-03ef6cbbdc0a"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:57:49.278807 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-61b70c51-fbce-4745-a7a0-6337fb81326f req-e8b482bf-22bd-4928-a906-f840c3950be9 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:49.279529 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-61b70c51-fbce-4745-a7a0-6337fb81326f req-e8b482bf-22bd-4928-a906-f840c3950be9 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:49.298810 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-61b70c51-fbce-4745-a7a0-6337fb81326f req-e8b482bf-22bd-4928-a906-f840c3950be9 service nova] Creating event network-changed:d6b08e27-3091-4087-a29a-03ef6cbbdc0a for instance 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f on hv-cinder-79760 Jun 03 09:57:49.306226 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-61b70c51-fbce-4745-a7a0-6337fb81326f req-e8b482bf-22bd-4928-a906-f840c3950be9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040442 Jun 03 09:57:49.307798 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 96/171] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 09:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:57:49.966215 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-736eaa61-2744-43de-9463-7507e8a21002 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:49.966923 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-736eaa61-2744-43de-9463-7507e8a21002 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:49.974010 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-736eaa61-2744-43de-9463-7507e8a21002 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:49.974710 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-736eaa61-2744-43de-9463-7507e8a21002 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:49.976211 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-736eaa61-2744-43de-9463-7507e8a21002 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:49.976936 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-736eaa61-2744-43de-9463-7507e8a21002 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:50.234196 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-736eaa61-2744-43de-9463-7507e8a21002 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:50.242734 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-736eaa61-2744-43de-9463-7507e8a21002 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e" status: 200 len: 1365 microversion: 2.1 time: 0.281041 Jun 03 09:57:50.243621 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 97/172] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:49 2022] GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e => generated 1365 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:57:50.283453 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-4fadcaaa-b371-4b8d-8985-bc47a9e655cd tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:50.284622 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-4fadcaaa-b371-4b8d-8985-bc47a9e655cd tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:50.292203 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4fadcaaa-b371-4b8d-8985-bc47a9e655cd tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:50.292833 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4fadcaaa-b371-4b8d-8985-bc47a9e655cd tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:50.310930 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4fadcaaa-b371-4b8d-8985-bc47a9e655cd tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:50.311396 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4fadcaaa-b371-4b8d-8985-bc47a9e655cd tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:50.484805 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-4fadcaaa-b371-4b8d-8985-bc47a9e655cd tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:50.493950 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-4fadcaaa-b371-4b8d-8985-bc47a9e655cd tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1522 microversion: 2.1 time: 0.216808 Jun 03 09:57:50.494535 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 98/173] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:50 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:51.260432 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-bf9597aa-ad19-49fe-87d7-76f6cd2b708d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:51.261201 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-bf9597aa-ad19-49fe-87d7-76f6cd2b708d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:51.267717 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bf9597aa-ad19-49fe-87d7-76f6cd2b708d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:51.268159 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bf9597aa-ad19-49fe-87d7-76f6cd2b708d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:51.268906 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bf9597aa-ad19-49fe-87d7-76f6cd2b708d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:51.269331 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bf9597aa-ad19-49fe-87d7-76f6cd2b708d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:51.417215 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-bf9597aa-ad19-49fe-87d7-76f6cd2b708d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:51.426297 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-bf9597aa-ad19-49fe-87d7-76f6cd2b708d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e" status: 200 len: 1365 microversion: 2.1 time: 0.169454 Jun 03 09:57:51.426867 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 99/174] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:51 2022] GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:57:51.510541 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-b2dd2530-1fe1-40f9-8a30-c8214a04adf0 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:51.511153 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-b2dd2530-1fe1-40f9-8a30-c8214a04adf0 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:51.518479 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b2dd2530-1fe1-40f9-8a30-c8214a04adf0 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:51.519048 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b2dd2530-1fe1-40f9-8a30-c8214a04adf0 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:51.520119 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b2dd2530-1fe1-40f9-8a30-c8214a04adf0 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:51.520564 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b2dd2530-1fe1-40f9-8a30-c8214a04adf0 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:51.669923 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-b2dd2530-1fe1-40f9-8a30-c8214a04adf0 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:51.679127 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-b2dd2530-1fe1-40f9-8a30-c8214a04adf0 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1522 microversion: 2.1 time: 0.172106 Jun 03 09:57:51.680515 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 100/175] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:51 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:52.384604 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_api:SELECT=19 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:52.442707 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-2cdec4fa-8e85-4833-88e1-5a343c069ae6 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:52.443344 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-2cdec4fa-8e85-4833-88e1-5a343c069ae6 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:52.449391 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2cdec4fa-8e85-4833-88e1-5a343c069ae6 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:52.449871 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2cdec4fa-8e85-4833-88e1-5a343c069ae6 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:52.450620 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2cdec4fa-8e85-4833-88e1-5a343c069ae6 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:52.451131 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2cdec4fa-8e85-4833-88e1-5a343c069ae6 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:52.514571 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell1:SELECT=15 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:57:52.578020 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-2cdec4fa-8e85-4833-88e1-5a343c069ae6 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:52.585402 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-2cdec4fa-8e85-4833-88e1-5a343c069ae6 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e" status: 200 len: 1365 microversion: 2.1 time: 0.146470 Jun 03 09:57:52.586009 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 101/176] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:52 2022] GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:57:52.697503 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-27705fe5-e060-409a-baab-09461dd6c783 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:52.698227 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-27705fe5-e060-409a-baab-09461dd6c783 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:52.706053 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-27705fe5-e060-409a-baab-09461dd6c783 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:52.706501 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-27705fe5-e060-409a-baab-09461dd6c783 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:52.707259 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-27705fe5-e060-409a-baab-09461dd6c783 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:52.707698 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-27705fe5-e060-409a-baab-09461dd6c783 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:52.832567 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-27705fe5-e060-409a-baab-09461dd6c783 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:52.840483 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-27705fe5-e060-409a-baab-09461dd6c783 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1522 microversion: 2.1 time: 0.147061 Jun 03 09:57:52.841054 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 102/177] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:52 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:57:53.268057 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-24dd7ed7-1f9a-45a5-bf2a-9e34b65e63bb tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] 10.222.0.45 "POST /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 10.893640 Jun 03 09:57:53.268962 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 76/178] 10.222.0.45 () {60 vars in 1322 bytes} [Fri Jun 3 09:57:42 2022] POST /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9/os-volume_attachments => generated 194 bytes in 10896 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:57:53.601968 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-765faa5d-bf44-437a-982c-2392b9282383 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:53.602635 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-765faa5d-bf44-437a-982c-2392b9282383 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:53.609603 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-765faa5d-bf44-437a-982c-2392b9282383 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:53.610600 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-765faa5d-bf44-437a-982c-2392b9282383 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:53.611375 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-765faa5d-bf44-437a-982c-2392b9282383 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:53.611838 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-765faa5d-bf44-437a-982c-2392b9282383 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:53.758480 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-765faa5d-bf44-437a-982c-2392b9282383 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:53.767014 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-765faa5d-bf44-437a-982c-2392b9282383 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e" status: 200 len: 1365 microversion: 2.1 time: 0.168820 Jun 03 09:57:53.767578 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 103/179] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:53 2022] GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:53.859024 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-d73cb8a5-1e16-48f1-a134-7e0dfec1e133 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:53.859724 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-d73cb8a5-1e16-48f1-a134-7e0dfec1e133 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:53.865981 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d73cb8a5-1e16-48f1-a134-7e0dfec1e133 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:53.866430 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d73cb8a5-1e16-48f1-a134-7e0dfec1e133 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:53.867197 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d73cb8a5-1e16-48f1-a134-7e0dfec1e133 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:53.867636 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d73cb8a5-1e16-48f1-a134-7e0dfec1e133 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:54.015833 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d73cb8a5-1e16-48f1-a134-7e0dfec1e133 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:54.024703 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-d73cb8a5-1e16-48f1-a134-7e0dfec1e133 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1522 microversion: 2.1 time: 0.170045 Jun 03 09:57:54.025399 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 77/180] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:53 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:54.783794 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-000c2df6-5e8f-46ce-90eb-cd6f3f5545ea tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:54.784613 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-000c2df6-5e8f-46ce-90eb-cd6f3f5545ea tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:54.790992 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-000c2df6-5e8f-46ce-90eb-cd6f3f5545ea tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:54.791450 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-000c2df6-5e8f-46ce-90eb-cd6f3f5545ea tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:54.792207 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-000c2df6-5e8f-46ce-90eb-cd6f3f5545ea tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:54.792807 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-000c2df6-5e8f-46ce-90eb-cd6f3f5545ea tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:54.937135 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-000c2df6-5e8f-46ce-90eb-cd6f3f5545ea tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:54.944693 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-000c2df6-5e8f-46ce-90eb-cd6f3f5545ea tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e" status: 200 len: 1365 microversion: 2.1 time: 0.165544 Jun 03 09:57:54.945417 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 104/181] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:54 2022] GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:55.044381 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-07e0d464-b793-4424-b718-4898eb6afb42 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:55.044931 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-07e0d464-b793-4424-b718-4898eb6afb42 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:55.051669 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-07e0d464-b793-4424-b718-4898eb6afb42 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:55.052122 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-07e0d464-b793-4424-b718-4898eb6afb42 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:55.052888 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-07e0d464-b793-4424-b718-4898eb6afb42 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:55.053329 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-07e0d464-b793-4424-b718-4898eb6afb42 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:55.268071 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-07e0d464-b793-4424-b718-4898eb6afb42 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:55.276158 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-07e0d464-b793-4424-b718-4898eb6afb42 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1522 microversion: 2.1 time: 0.237228 Jun 03 09:57:55.277197 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 78/182] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:55 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:55.968264 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-dbcf8781-a5dd-4790-b7e8-d53f2acf6c75 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:55.971097 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-dbcf8781-a5dd-4790-b7e8-d53f2acf6c75 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:55.977974 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-dbcf8781-a5dd-4790-b7e8-d53f2acf6c75 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:55.978626 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-dbcf8781-a5dd-4790-b7e8-d53f2acf6c75 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:55.979567 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-dbcf8781-a5dd-4790-b7e8-d53f2acf6c75 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:55.980006 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-dbcf8781-a5dd-4790-b7e8-d53f2acf6c75 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:56.156632 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-dbcf8781-a5dd-4790-b7e8-d53f2acf6c75 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:56.164609 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-dbcf8781-a5dd-4790-b7e8-d53f2acf6c75 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e" status: 200 len: 1556 microversion: 2.1 time: 0.204730 Jun 03 09:57:56.165394 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 105/183] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:55 2022] GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e => generated 1556 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:56.182918 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-50fc936a-7442-47c2-a4b0-cd4ac2b6ce4a tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:56.183607 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-50fc936a-7442-47c2-a4b0-cd4ac2b6ce4a tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:56.191119 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-50fc936a-7442-47c2-a4b0-cd4ac2b6ce4a tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:56.191890 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-50fc936a-7442-47c2-a4b0-cd4ac2b6ce4a tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:56.192875 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-50fc936a-7442-47c2-a4b0-cd4ac2b6ce4a tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:56.195561 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-50fc936a-7442-47c2-a4b0-cd4ac2b6ce4a tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:56.288680 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-50fc936a-7442-47c2-a4b0-cd4ac2b6ce4a tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.111040 Jun 03 09:57:56.294051 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-7a5387df-beb4-4e0c-ab54-7be47df879e3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:56.294669 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-7a5387df-beb4-4e0c-ab54-7be47df879e3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:56.300872 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 79/184] 10.222.0.45 () {58 vars in 1274 bytes} [Fri Jun 3 09:57:56 2022] GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e/os-interface => generated 285 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:57:56.301175 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7a5387df-beb4-4e0c-ab54-7be47df879e3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:56.301634 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7a5387df-beb4-4e0c-ab54-7be47df879e3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:56.302439 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7a5387df-beb4-4e0c-ab54-7be47df879e3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:56.303125 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7a5387df-beb4-4e0c-ab54-7be47df879e3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:56.453561 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-7a5387df-beb4-4e0c-ab54-7be47df879e3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:56.462709 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-7a5387df-beb4-4e0c-ab54-7be47df879e3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1522 microversion: 2.1 time: 0.171477 Jun 03 09:57:56.463502 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 106/185] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:56 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:57:57.480249 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-d8e758e7-aa64-44c5-a6d6-dc8f6a1eeecc tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:57.480868 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-d8e758e7-aa64-44c5-a6d6-dc8f6a1eeecc tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:57.488093 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d8e758e7-aa64-44c5-a6d6-dc8f6a1eeecc tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:57.488551 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d8e758e7-aa64-44c5-a6d6-dc8f6a1eeecc tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:57.489329 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d8e758e7-aa64-44c5-a6d6-dc8f6a1eeecc tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:57.489815 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d8e758e7-aa64-44c5-a6d6-dc8f6a1eeecc tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:57.712962 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d8e758e7-aa64-44c5-a6d6-dc8f6a1eeecc tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:57.752203 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-d8e758e7-aa64-44c5-a6d6-dc8f6a1eeecc tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1522 microversion: 2.1 time: 0.273849 Jun 03 09:57:57.756922 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 80/186] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:57 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:57:58.073587 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-1b46a86a-5919-44a0-83af-d41e95307615 req-2b64b28b-9b68-430b-ae1a-662317024d56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e", "tag": "9ce3fd34-d579-4eda-8b0a-3d97ea2da07d"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:57:58.088364 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-1b46a86a-5919-44a0-83af-d41e95307615 req-2b64b28b-9b68-430b-ae1a-662317024d56 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:58.089227 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-1b46a86a-5919-44a0-83af-d41e95307615 req-2b64b28b-9b68-430b-ae1a-662317024d56 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:58.108110 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-1b46a86a-5919-44a0-83af-d41e95307615 req-2b64b28b-9b68-430b-ae1a-662317024d56 service nova] Creating event network-changed:9ce3fd34-d579-4eda-8b0a-3d97ea2da07d for instance 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e on hv-cinder-79760 Jun 03 09:57:58.114893 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-1b46a86a-5919-44a0-83af-d41e95307615 req-2b64b28b-9b68-430b-ae1a-662317024d56 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045715 Jun 03 09:57:58.116390 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 107/187] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 09:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:57:58.772742 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-57ee7571-de36-4444-a181-b1ea9cf8c035 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:57:58.773346 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-57ee7571-de36-4444-a181-b1ea9cf8c035 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:57:58.779696 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-57ee7571-de36-4444-a181-b1ea9cf8c035 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:58.781717 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-57ee7571-de36-4444-a181-b1ea9cf8c035 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:58.787232 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-57ee7571-de36-4444-a181-b1ea9cf8c035 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:57:58.787689 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-57ee7571-de36-4444-a181-b1ea9cf8c035 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:57:59.023654 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-57ee7571-de36-4444-a181-b1ea9cf8c035 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:57:59.032907 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-57ee7571-de36-4444-a181-b1ea9cf8c035 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1522 microversion: 2.1 time: 0.263767 Jun 03 09:57:59.033799 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 81/188] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:57:58 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:00.051368 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-12c4726c-5b1d-4c56-8319-af8a6e61c90f tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:00.052402 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-12c4726c-5b1d-4c56-8319-af8a6e61c90f tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:00.058881 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-12c4726c-5b1d-4c56-8319-af8a6e61c90f tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:00.059326 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-12c4726c-5b1d-4c56-8319-af8a6e61c90f tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:00.060125 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-12c4726c-5b1d-4c56-8319-af8a6e61c90f tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:00.060601 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-12c4726c-5b1d-4c56-8319-af8a6e61c90f tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:00.278466 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-12c4726c-5b1d-4c56-8319-af8a6e61c90f tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:00.289310 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-12c4726c-5b1d-4c56-8319-af8a6e61c90f tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1522 microversion: 2.1 time: 0.243013 Jun 03 09:58:00.290679 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 108/189] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:00 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:01.312788 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-8839a771-4c0c-4bb1-856c-1dc3dad68b27 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:01.313321 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-8839a771-4c0c-4bb1-856c-1dc3dad68b27 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:01.319913 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8839a771-4c0c-4bb1-856c-1dc3dad68b27 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:01.320356 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8839a771-4c0c-4bb1-856c-1dc3dad68b27 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:01.321111 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8839a771-4c0c-4bb1-856c-1dc3dad68b27 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:01.321561 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8839a771-4c0c-4bb1-856c-1dc3dad68b27 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:01.451358 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-8839a771-4c0c-4bb1-856c-1dc3dad68b27 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:01.458898 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-8839a771-4c0c-4bb1-856c-1dc3dad68b27 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1522 microversion: 2.1 time: 0.150040 Jun 03 09:58:01.459468 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 82/190] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:01 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:02.475494 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-a3102b71-a774-4830-bef6-9d3fb22c85a0 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:02.476106 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-a3102b71-a774-4830-bef6-9d3fb22c85a0 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:02.482325 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a3102b71-a774-4830-bef6-9d3fb22c85a0 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:02.482782 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a3102b71-a774-4830-bef6-9d3fb22c85a0 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:02.483541 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a3102b71-a774-4830-bef6-9d3fb22c85a0 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:02.483981 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a3102b71-a774-4830-bef6-9d3fb22c85a0 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:02.614395 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-a3102b71-a774-4830-bef6-9d3fb22c85a0 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:02.622107 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-a3102b71-a774-4830-bef6-9d3fb22c85a0 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1522 microversion: 2.1 time: 0.150382 Jun 03 09:58:02.622666 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 109/191] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:02 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:03.638838 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-4791daf2-c3fd-40c9-8411-d8e537e570d1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:03.639470 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-4791daf2-c3fd-40c9-8411-d8e537e570d1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:03.646897 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4791daf2-c3fd-40c9-8411-d8e537e570d1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:03.647285 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4791daf2-c3fd-40c9-8411-d8e537e570d1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:03.648042 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4791daf2-c3fd-40c9-8411-d8e537e570d1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:03.648497 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4791daf2-c3fd-40c9-8411-d8e537e570d1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:03.778838 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-4791daf2-c3fd-40c9-8411-d8e537e570d1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:03.788163 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-4791daf2-c3fd-40c9-8411-d8e537e570d1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1522 microversion: 2.1 time: 0.153177 Jun 03 09:58:03.788739 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 83/192] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:03 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:04.805359 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-5a22bd55-735d-4f50-bffc-81016a2b6b01 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:04.805995 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-5a22bd55-735d-4f50-bffc-81016a2b6b01 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:04.811984 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5a22bd55-735d-4f50-bffc-81016a2b6b01 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:04.812455 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5a22bd55-735d-4f50-bffc-81016a2b6b01 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:04.813807 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5a22bd55-735d-4f50-bffc-81016a2b6b01 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:04.814243 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5a22bd55-735d-4f50-bffc-81016a2b6b01 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:04.944142 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-5a22bd55-735d-4f50-bffc-81016a2b6b01 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:04.951705 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-5a22bd55-735d-4f50-bffc-81016a2b6b01 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1522 microversion: 2.1 time: 0.150099 Jun 03 09:58:04.952312 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 110/193] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:04 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:05.968868 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-8d94465f-bc0e-475a-ab8c-dcd708bcb0f1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:05.970019 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-8d94465f-bc0e-475a-ab8c-dcd708bcb0f1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:05.977006 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8d94465f-bc0e-475a-ab8c-dcd708bcb0f1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:05.977455 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8d94465f-bc0e-475a-ab8c-dcd708bcb0f1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:05.978252 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8d94465f-bc0e-475a-ab8c-dcd708bcb0f1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:05.978725 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8d94465f-bc0e-475a-ab8c-dcd708bcb0f1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:06.134926 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-8d94465f-bc0e-475a-ab8c-dcd708bcb0f1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:06.144184 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-8d94465f-bc0e-475a-ab8c-dcd708bcb0f1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1522 microversion: 2.1 time: 0.179058 Jun 03 09:58:06.145433 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 84/194] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:05 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:07.161719 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-a2a5301e-0045-4983-8fc6-b945cee5bc87 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:07.162321 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-a2a5301e-0045-4983-8fc6-b945cee5bc87 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:07.168296 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a2a5301e-0045-4983-8fc6-b945cee5bc87 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:07.168737 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a2a5301e-0045-4983-8fc6-b945cee5bc87 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:07.169488 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a2a5301e-0045-4983-8fc6-b945cee5bc87 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:07.169944 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a2a5301e-0045-4983-8fc6-b945cee5bc87 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:07.303230 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-a2a5301e-0045-4983-8fc6-b945cee5bc87 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:07.310680 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-a2a5301e-0045-4983-8fc6-b945cee5bc87 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1522 microversion: 2.1 time: 0.152820 Jun 03 09:58:07.311253 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 111/195] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:07 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:08.326900 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-3a3ef5f9-11ee-4b80-bd6b-983b26b6b550 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:08.327510 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-3a3ef5f9-11ee-4b80-bd6b-983b26b6b550 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:08.334581 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3a3ef5f9-11ee-4b80-bd6b-983b26b6b550 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:08.335001 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3a3ef5f9-11ee-4b80-bd6b-983b26b6b550 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:08.335874 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3a3ef5f9-11ee-4b80-bd6b-983b26b6b550 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:08.336394 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3a3ef5f9-11ee-4b80-bd6b-983b26b6b550 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:08.485650 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-3a3ef5f9-11ee-4b80-bd6b-983b26b6b550 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:08.493725 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-3a3ef5f9-11ee-4b80-bd6b-983b26b6b550 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1522 microversion: 2.1 time: 0.170497 Jun 03 09:58:08.494325 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 85/196] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:08 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:08.601694 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-08439ea0-0990-4c61-bd70-f1c56d18ddc5 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:08.602219 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-08439ea0-0990-4c61-bd70-f1c56d18ddc5 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] [instance: 85a66cd0-df20-4640-849b-73f7f01329b9] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:08.609642 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-08439ea0-0990-4c61-bd70-f1c56d18ddc5 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:08.610814 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-08439ea0-0990-4c61-bd70-f1c56d18ddc5 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:08.611894 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-08439ea0-0990-4c61-bd70-f1c56d18ddc5 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:08.612426 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-08439ea0-0990-4c61-bd70-f1c56d18ddc5 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:08.639052 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-08439ea0-0990-4c61-bd70-f1c56d18ddc5 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] [instance: 85a66cd0-df20-4640-849b-73f7f01329b9] Going to try to terminate instance {{(pid=117647) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 09:58:08.642454 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=100 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:08.731821 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-08439ea0-0990-4c61-bd70-f1c56d18ddc5 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] 10.222.0.45 "DELETE /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9" status: 204 len: 0 microversion: 2.1 time: 0.133452 Jun 03 09:58:08.732564 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 112/197] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jun 3 09:58:08 2022] DELETE /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 09:58:08.740773 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-e64bdf8b-b783-4e21-ac82-8f5163368575 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:08.741401 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-e64bdf8b-b783-4e21-ac82-8f5163368575 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] [instance: 85a66cd0-df20-4640-849b-73f7f01329b9] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:08.749322 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e64bdf8b-b783-4e21-ac82-8f5163368575 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:08.749793 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e64bdf8b-b783-4e21-ac82-8f5163368575 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:08.751206 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e64bdf8b-b783-4e21-ac82-8f5163368575 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:08.751644 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e64bdf8b-b783-4e21-ac82-8f5163368575 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:08.900003 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-e64bdf8b-b783-4e21-ac82-8f5163368575 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e257ae4e744dd8a0553b7c2abee529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae18a142aa2049ffa07fc6516203f6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:08.909975 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-e64bdf8b-b783-4e21-ac82-8f5163368575 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] 10.222.0.45 "GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9" status: 200 len: 1555 microversion: 2.1 time: 0.172810 Jun 03 09:58:08.910555 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 86/198] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:08 2022] GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9 => generated 1555 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:09.511045 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-cc9aeb98-f0c0-4161-9491-f7798845e642 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:09.511737 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-cc9aeb98-f0c0-4161-9491-f7798845e642 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:09.518098 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cc9aeb98-f0c0-4161-9491-f7798845e642 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:09.518537 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cc9aeb98-f0c0-4161-9491-f7798845e642 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:09.519288 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cc9aeb98-f0c0-4161-9491-f7798845e642 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:09.519726 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cc9aeb98-f0c0-4161-9491-f7798845e642 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:09.650397 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-cc9aeb98-f0c0-4161-9491-f7798845e642 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:09.658219 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-cc9aeb98-f0c0-4161-9491-f7798845e642 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1522 microversion: 2.1 time: 0.151391 Jun 03 09:58:09.658784 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 113/199] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:09 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:09.927429 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-c51784a3-d29d-4e6c-a692-09207c185d9f tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:09.928109 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-c51784a3-d29d-4e6c-a692-09207c185d9f tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] [instance: 85a66cd0-df20-4640-849b-73f7f01329b9] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:09.935266 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c51784a3-d29d-4e6c-a692-09207c185d9f tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:09.935830 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c51784a3-d29d-4e6c-a692-09207c185d9f tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:09.937205 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c51784a3-d29d-4e6c-a692-09207c185d9f tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:09.937492 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c51784a3-d29d-4e6c-a692-09207c185d9f tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:10.086176 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-c51784a3-d29d-4e6c-a692-09207c185d9f tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e257ae4e744dd8a0553b7c2abee529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae18a142aa2049ffa07fc6516203f6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:10.097857 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-c51784a3-d29d-4e6c-a692-09207c185d9f tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] 10.222.0.45 "GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9" status: 200 len: 1555 microversion: 2.1 time: 0.174057 Jun 03 09:58:10.098450 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 87/200] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:09 2022] GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9 => generated 1555 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:10.675110 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-9c13373c-aad7-462f-8ca6-d3f5ee5c594e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:10.675729 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-9c13373c-aad7-462f-8ca6-d3f5ee5c594e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:10.681730 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9c13373c-aad7-462f-8ca6-d3f5ee5c594e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:10.682213 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9c13373c-aad7-462f-8ca6-d3f5ee5c594e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:10.683057 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9c13373c-aad7-462f-8ca6-d3f5ee5c594e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:10.683496 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9c13373c-aad7-462f-8ca6-d3f5ee5c594e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:10.815632 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-9c13373c-aad7-462f-8ca6-d3f5ee5c594e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:10.823187 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-9c13373c-aad7-462f-8ca6-d3f5ee5c594e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1522 microversion: 2.1 time: 0.152444 Jun 03 09:58:10.823758 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 114/201] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:10 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:11.114965 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-64cda671-e241-4abe-afb0-f6c4c689cfac tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:11.115588 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-64cda671-e241-4abe-afb0-f6c4c689cfac tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] [instance: 85a66cd0-df20-4640-849b-73f7f01329b9] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:11.122143 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-64cda671-e241-4abe-afb0-f6c4c689cfac tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:11.122598 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-64cda671-e241-4abe-afb0-f6c4c689cfac tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:11.123365 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-64cda671-e241-4abe-afb0-f6c4c689cfac tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:11.123803 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-64cda671-e241-4abe-afb0-f6c4c689cfac tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:11.255859 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-64cda671-e241-4abe-afb0-f6c4c689cfac tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e257ae4e744dd8a0553b7c2abee529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae18a142aa2049ffa07fc6516203f6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:11.264140 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-64cda671-e241-4abe-afb0-f6c4c689cfac tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] 10.222.0.45 "GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9" status: 200 len: 1555 microversion: 2.1 time: 0.152888 Jun 03 09:58:11.264788 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 88/202] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:11 2022] GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9 => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:11.839960 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-9e9b24b9-be29-4baa-be80-3280734175cd tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:11.840511 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-9e9b24b9-be29-4baa-be80-3280734175cd tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:11.842565 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:11.847968 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9e9b24b9-be29-4baa-be80-3280734175cd tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:11.848417 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9e9b24b9-be29-4baa-be80-3280734175cd tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:11.849212 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9e9b24b9-be29-4baa-be80-3280734175cd tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:11.849646 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9e9b24b9-be29-4baa-be80-3280734175cd tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:11.984011 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-9e9b24b9-be29-4baa-be80-3280734175cd tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:11.991762 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-9e9b24b9-be29-4baa-be80-3280734175cd tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1522 microversion: 2.1 time: 0.155682 Jun 03 09:58:11.992338 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 115/203] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:11 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:12.283599 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-28f7e317-8070-4d5c-9cec-546042f2b202 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:12.284352 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-28f7e317-8070-4d5c-9cec-546042f2b202 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] [instance: 85a66cd0-df20-4640-849b-73f7f01329b9] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:12.290299 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-28f7e317-8070-4d5c-9cec-546042f2b202 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:12.290791 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-28f7e317-8070-4d5c-9cec-546042f2b202 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:12.291560 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-28f7e317-8070-4d5c-9cec-546042f2b202 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:12.291994 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-28f7e317-8070-4d5c-9cec-546042f2b202 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:12.425046 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-28f7e317-8070-4d5c-9cec-546042f2b202 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e257ae4e744dd8a0553b7c2abee529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae18a142aa2049ffa07fc6516203f6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:12.433215 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-28f7e317-8070-4d5c-9cec-546042f2b202 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] 10.222.0.45 "GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9" status: 200 len: 1555 microversion: 2.1 time: 0.154627 Jun 03 09:58:12.433810 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 89/204] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:12 2022] GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9 => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:13.008913 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-94e9593c-a43d-448f-b885-ced8f6d09b4d req-bf41a597-5497-401e-a0d2-ac2deb3f14f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85a66cd0-df20-4640-849b-73f7f01329b9", "name": "network-vif-deleted", "tag": "736d00ec-ca8b-4f89-9a8a-c45962886815"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:58:13.009481 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-a8c3c61d-995c-437b-b4f4-384d068b1a1a tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:13.009796 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-a8c3c61d-995c-437b-b4f4-384d068b1a1a tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:13.017078 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a8c3c61d-995c-437b-b4f4-384d068b1a1a tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:13.017529 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a8c3c61d-995c-437b-b4f4-384d068b1a1a tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:13.018037 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-94e9593c-a43d-448f-b885-ced8f6d09b4d req-bf41a597-5497-401e-a0d2-ac2deb3f14f5 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:13.018805 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-94e9593c-a43d-448f-b885-ced8f6d09b4d req-bf41a597-5497-401e-a0d2-ac2deb3f14f5 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:13.019048 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a8c3c61d-995c-437b-b4f4-384d068b1a1a tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:13.020219 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a8c3c61d-995c-437b-b4f4-384d068b1a1a tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:13.039359 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-94e9593c-a43d-448f-b885-ced8f6d09b4d req-bf41a597-5497-401e-a0d2-ac2deb3f14f5 service nova] Creating event network-vif-deleted:736d00ec-ca8b-4f89-9a8a-c45962886815 for instance 85a66cd0-df20-4640-849b-73f7f01329b9 on hv-cinder-79760 Jun 03 09:58:13.049881 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-94e9593c-a43d-448f-b885-ced8f6d09b4d req-bf41a597-5497-401e-a0d2-ac2deb3f14f5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045261 Jun 03 09:58:13.051138 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 116/205] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 09:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:58:13.166440 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-a8c3c61d-995c-437b-b4f4-384d068b1a1a tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:13.173774 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-a8c3c61d-995c-437b-b4f4-384d068b1a1a tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1522 microversion: 2.1 time: 0.168581 Jun 03 09:58:13.174341 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 90/206] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:13 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:13.452302 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-5563c4a0-c17f-4caf-8194-012e66ab6e60 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:13.453002 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-5563c4a0-c17f-4caf-8194-012e66ab6e60 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] [instance: 85a66cd0-df20-4640-849b-73f7f01329b9] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:13.460259 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5563c4a0-c17f-4caf-8194-012e66ab6e60 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:13.460744 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5563c4a0-c17f-4caf-8194-012e66ab6e60 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:13.461512 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5563c4a0-c17f-4caf-8194-012e66ab6e60 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:13.461978 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5563c4a0-c17f-4caf-8194-012e66ab6e60 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:13.537560 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-5563c4a0-c17f-4caf-8194-012e66ab6e60 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e257ae4e744dd8a0553b7c2abee529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae18a142aa2049ffa07fc6516203f6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:13.546060 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-5563c4a0-c17f-4caf-8194-012e66ab6e60 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] 10.222.0.45 "GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9" status: 200 len: 1346 microversion: 2.1 time: 0.098326 Jun 03 09:58:13.546630 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 117/207] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:13 2022] GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9 => generated 1346 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:14.190844 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-0dd216c0-dac2-44b3-8ecb-0bee4600d6d0 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:14.191513 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-0dd216c0-dac2-44b3-8ecb-0bee4600d6d0 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:14.198173 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0dd216c0-dac2-44b3-8ecb-0bee4600d6d0 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:14.198618 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0dd216c0-dac2-44b3-8ecb-0bee4600d6d0 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:14.199536 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0dd216c0-dac2-44b3-8ecb-0bee4600d6d0 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:14.199974 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0dd216c0-dac2-44b3-8ecb-0bee4600d6d0 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:14.346328 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-0dd216c0-dac2-44b3-8ecb-0bee4600d6d0 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:14.353921 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-0dd216c0-dac2-44b3-8ecb-0bee4600d6d0 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1522 microversion: 2.1 time: 0.166835 Jun 03 09:58:14.354482 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 91/208] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:14 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:14.562931 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-b19536d4-2694-4582-a177-34935d490f1d tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:14.563904 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-b19536d4-2694-4582-a177-34935d490f1d tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] [instance: 85a66cd0-df20-4640-849b-73f7f01329b9] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:14.571492 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b19536d4-2694-4582-a177-34935d490f1d tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:14.572481 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b19536d4-2694-4582-a177-34935d490f1d tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:14.572967 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b19536d4-2694-4582-a177-34935d490f1d tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:14.573397 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b19536d4-2694-4582-a177-34935d490f1d tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:14.610844 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b19536d4-2694-4582-a177-34935d490f1d tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:14.611528 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b19536d4-2694-4582-a177-34935d490f1d tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:14.612078 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.objects.instance [None req-b19536d4-2694-4582-a177-34935d490f1d tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lazy-loading 'fault' on Instance uuid 85a66cd0-df20-4640-849b-73f7f01329b9 {{(pid=117647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 09:58:14.661482 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-b19536d4-2694-4582-a177-34935d490f1d tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2e257ae4e744dd8a0553b7c2abee529', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae18a142aa2049ffa07fc6516203f6fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:14.669141 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-b19536d4-2694-4582-a177-34935d490f1d tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] 10.222.0.45 "GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9" status: 200 len: 1305 microversion: 2.1 time: 0.110304 Jun 03 09:58:14.669717 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 118/209] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:14 2022] GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9 => generated 1305 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:15.373387 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-ff485624-1fbb-4a82-8eb8-5a3bd2070ebe tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:15.374143 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-ff485624-1fbb-4a82-8eb8-5a3bd2070ebe tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:15.381531 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ff485624-1fbb-4a82-8eb8-5a3bd2070ebe tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:15.382092 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ff485624-1fbb-4a82-8eb8-5a3bd2070ebe tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:15.383287 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ff485624-1fbb-4a82-8eb8-5a3bd2070ebe tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:15.383841 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ff485624-1fbb-4a82-8eb8-5a3bd2070ebe tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:15.403706 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:15.562899 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-ff485624-1fbb-4a82-8eb8-5a3bd2070ebe tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:15.571118 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-ff485624-1fbb-4a82-8eb8-5a3bd2070ebe tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1522 microversion: 2.1 time: 0.202443 Jun 03 09:58:15.580369 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 92/210] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:15 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:15.685308 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-6bc6d4f6-b6f6-4c34-a6cc-1900365182bb tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:15.686093 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-6bc6d4f6-b6f6-4c34-a6cc-1900365182bb tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] [instance: 85a66cd0-df20-4640-849b-73f7f01329b9] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:15.692305 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6bc6d4f6-b6f6-4c34-a6cc-1900365182bb tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:15.692966 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6bc6d4f6-b6f6-4c34-a6cc-1900365182bb tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:15.693766 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6bc6d4f6-b6f6-4c34-a6cc-1900365182bb tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:15.694212 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6bc6d4f6-b6f6-4c34-a6cc-1900365182bb tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:15.709047 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.wsgi [None req-6bc6d4f6-b6f6-4c34-a6cc-1900365182bb tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] HTTP exception thrown: Instance 85a66cd0-df20-4640-849b-73f7f01329b9 could not be found. Jun 03 09:58:15.713838 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-6bc6d4f6-b6f6-4c34-a6cc-1900365182bb tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Request method failure captured: Jun 03 09:58:15.713838 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: request: GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9 HTTP/1.1 Jun 03 09:58:15.713838 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Accept: application/json Jun 03 09:58:15.713838 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Accept-Encoding: identity Jun 03 09:58:15.713838 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Connection: close Jun 03 09:58:15.713838 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Content-Length: 0 Jun 03 09:58:15.713838 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Content-Type: application/json Jun 03 09:58:15.713838 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Host: 10.222.0.45 Jun 03 09:58:15.713838 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Openstack-System-Scope: None Jun 03 09:58:15.713838 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: User-Agent: python-urllib3/1.26.9 Jun 03 09:58:15.713838 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Auth-Token: gAAAAABimdrYCpQwNEBKNY_u07oLFtgeGOEZmK1rFDAvEXyFwSWAtev7iWIgetSL7hmQ0vQKa-9xWGtTGTJpCJWJH-Hyn6gO_vamG3wWizmlBrmmhkfXKxCHnxK92Iubp2KlNPYEi5QVR9MXinhCAKGLfeT5yGEEJYPlL10yJJr5SlCLwN74SSk Jun 03 09:58:15.713838 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Domain-Id: None Jun 03 09:58:15.713838 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Domain-Name: None Jun 03 09:58:15.713838 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Identity-Status: Confirmed Jun 03 09:58:15.713838 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Is-Admin-Project: True Jun 03 09:58:15.713838 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Domain-Id: default Jun 03 09:58:15.713838 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Domain-Name: Default Jun 03 09:58:15.713838 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Id: ae18a142aa2049ffa07fc6516203f6fe Jun 03 09:58:15.713838 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Name: tempest-DeleteServersTestJSON-200873024 Jun 03 09:58:15.713838 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Role: member,reader Jun 03 09:58:15.713838 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Roles: member,reader Jun 03 09:58:15.715306 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ae18a142aa2049ffa07fc6516203f6fe", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ae18a142aa2049ffa07fc6516203f6fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ae18a142aa2049ffa07fc6516203f6fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ae18a142aa2049ffa07fc6516203f6fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 09:58:15.715306 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant: tempest-DeleteServersTestJSON-200873024 Jun 03 09:58:15.715306 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant-Id: ae18a142aa2049ffa07fc6516203f6fe Jun 03 09:58:15.715306 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant-Name: tempest-DeleteServersTestJSON-200873024 Jun 03 09:58:15.715306 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User: tempest-DeleteServersTestJSON-200873024-project Jun 03 09:58:15.715306 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Domain-Id: default Jun 03 09:58:15.715306 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Domain-Name: Default Jun 03 09:58:15.715306 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Id: c2e257ae4e744dd8a0553b7c2abee529 Jun 03 09:58:15.715306 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Name: tempest-DeleteServersTestJSON-200873024-project Jun 03 09:58:15.715306 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: method: > Jun 03 09:58:15.715306 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: exception: Instance 85a66cd0-df20-4640-849b-73f7f01329b9 could not be found. Jun 03 09:58:15.715306 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: action_args: {'id': '85a66cd0-df20-4640-849b-73f7f01329b9'} Jun 03 09:58:15.716176 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:58:15.716176 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:58:15.716176 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 09:58:15.716176 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 09:58:15.716176 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 09:58:15.716176 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 09:58:15.716176 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 09:58:15.716176 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 09:58:15.716176 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 09:58:15.716176 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 09:58:15.716176 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85a66cd0-df20-4640-849b-73f7f01329b9 could not be found. Jun 03 09:58:15.716176 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 09:58:15.716176 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:58:15.716176 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 09:58:15.716176 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:58:15.716176 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:58:15.716176 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:58:15.716176 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:58:15.716176 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:58:15.716176 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:58:15.717479 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:58:15.717479 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 09:58:15.717479 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 09:58:15.717479 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 09:58:15.717479 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 09:58:15.717479 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 09:58:15.717479 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:58:15.717479 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85a66cd0-df20-4640-849b-73f7f01329b9 could not be found. Jun 03 09:58:15.717479 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 09:58:15.717479 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:58:15.717479 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 09:58:15.717479 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:58:15.717479 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:58:15.717479 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:58:15.717479 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:58:15.717479 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:58:15.717479 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85a66cd0-df20-4640-849b-73f7f01329b9 could not be found. Jun 03 09:58:15.717479 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 09:58:15.719802 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-6bc6d4f6-b6f6-4c34-a6cc-1900365182bb tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Returning 404 to user: Instance 85a66cd0-df20-4640-849b-73f7f01329b9 could not be found. {{(pid=117647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:58:15.720821 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-6bc6d4f6-b6f6-4c34-a6cc-1900365182bb tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] 10.222.0.45 "GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9" status: 404 len: 111 microversion: 2.1 time: 0.039328 Jun 03 09:58:15.722181 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 119/211] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:15 2022] GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:58:15.841861 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-9c3d4d95-72f3-45b0-ae7a-e3234a4073cb tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:15.842822 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-9c3d4d95-72f3-45b0-ae7a-e3234a4073cb tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] [instance: 85a66cd0-df20-4640-849b-73f7f01329b9] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:15.854270 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9c3d4d95-72f3-45b0-ae7a-e3234a4073cb tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:15.854595 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9c3d4d95-72f3-45b0-ae7a-e3234a4073cb tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:15.855576 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9c3d4d95-72f3-45b0-ae7a-e3234a4073cb tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:15.856098 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9c3d4d95-72f3-45b0-ae7a-e3234a4073cb tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:15.870411 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.wsgi [None req-9c3d4d95-72f3-45b0-ae7a-e3234a4073cb tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] HTTP exception thrown: Instance 85a66cd0-df20-4640-849b-73f7f01329b9 could not be found. Jun 03 09:58:15.875788 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-9c3d4d95-72f3-45b0-ae7a-e3234a4073cb tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Request method failure captured: Jun 03 09:58:15.875788 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: request: GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9/os-volume_attachments HTTP/1.1 Jun 03 09:58:15.875788 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept: application/json Jun 03 09:58:15.875788 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept-Encoding: identity Jun 03 09:58:15.875788 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Connection: close Jun 03 09:58:15.875788 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Length: 0 Jun 03 09:58:15.875788 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Type: application/json Jun 03 09:58:15.875788 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Host: 10.222.0.45 Jun 03 09:58:15.875788 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Openstack-System-Scope: None Jun 03 09:58:15.875788 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: User-Agent: python-urllib3/1.26.9 Jun 03 09:58:15.875788 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Auth-Token: gAAAAABimdrYCpQwNEBKNY_u07oLFtgeGOEZmK1rFDAvEXyFwSWAtev7iWIgetSL7hmQ0vQKa-9xWGtTGTJpCJWJH-Hyn6gO_vamG3wWizmlBrmmhkfXKxCHnxK92Iubp2KlNPYEi5QVR9MXinhCAKGLfeT5yGEEJYPlL10yJJr5SlCLwN74SSk Jun 03 09:58:15.875788 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Id: None Jun 03 09:58:15.875788 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Name: None Jun 03 09:58:15.875788 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Identity-Status: Confirmed Jun 03 09:58:15.875788 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Is-Admin-Project: True Jun 03 09:58:15.875788 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Id: default Jun 03 09:58:15.875788 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Name: Default Jun 03 09:58:15.875788 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Id: ae18a142aa2049ffa07fc6516203f6fe Jun 03 09:58:15.875788 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Name: tempest-DeleteServersTestJSON-200873024 Jun 03 09:58:15.875788 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Role: member,reader Jun 03 09:58:15.875788 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Roles: member,reader Jun 03 09:58:15.877579 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ae18a142aa2049ffa07fc6516203f6fe", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ae18a142aa2049ffa07fc6516203f6fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ae18a142aa2049ffa07fc6516203f6fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ae18a142aa2049ffa07fc6516203f6fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 09:58:15.877579 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant: tempest-DeleteServersTestJSON-200873024 Jun 03 09:58:15.877579 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Id: ae18a142aa2049ffa07fc6516203f6fe Jun 03 09:58:15.877579 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Name: tempest-DeleteServersTestJSON-200873024 Jun 03 09:58:15.877579 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User: tempest-DeleteServersTestJSON-200873024-project Jun 03 09:58:15.877579 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Id: default Jun 03 09:58:15.877579 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Name: Default Jun 03 09:58:15.877579 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Id: c2e257ae4e744dd8a0553b7c2abee529 Jun 03 09:58:15.877579 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Name: tempest-DeleteServersTestJSON-200873024-project Jun 03 09:58:15.877579 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: method: > Jun 03 09:58:15.877579 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: exception: Instance 85a66cd0-df20-4640-849b-73f7f01329b9 could not be found. Jun 03 09:58:15.877579 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: action_args: {'server_id': '85a66cd0-df20-4640-849b-73f7f01329b9'} Jun 03 09:58:15.878504 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:58:15.878504 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:58:15.878504 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 09:58:15.878504 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 09:58:15.878504 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 09:58:15.878504 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 09:58:15.878504 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 09:58:15.878504 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 09:58:15.878504 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 09:58:15.878504 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 09:58:15.878504 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85a66cd0-df20-4640-849b-73f7f01329b9 could not be found. Jun 03 09:58:15.878504 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 09:58:15.878504 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:58:15.878504 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 09:58:15.878504 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:58:15.878504 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:58:15.878504 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:58:15.878504 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:58:15.878504 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:58:15.878504 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:58:15.879799 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:58:15.879799 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 03 09:58:15.879799 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 09:58:15.879799 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 03 09:58:15.879799 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 09:58:15.879799 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 03 09:58:15.879799 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 03 09:58:15.879799 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 09:58:15.879799 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:58:15.879799 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85a66cd0-df20-4640-849b-73f7f01329b9 could not be found. Jun 03 09:58:15.879799 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 09:58:15.879799 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:58:15.879799 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 09:58:15.879799 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:58:15.879799 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:58:15.879799 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:58:15.879799 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:58:15.879799 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:58:15.879799 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85a66cd0-df20-4640-849b-73f7f01329b9 could not be found. Jun 03 09:58:15.879799 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 09:58:15.882264 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-9c3d4d95-72f3-45b0-ae7a-e3234a4073cb tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Returning 404 to user: Instance 85a66cd0-df20-4640-849b-73f7f01329b9 could not be found. {{(pid=117648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:58:15.883425 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-9c3d4d95-72f3-45b0-ae7a-e3234a4073cb tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] 10.222.0.45 "GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.046379 Jun 03 09:58:15.884539 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 93/212] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 3 09:58:15 2022] GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9/os-volume_attachments => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:58:16.589025 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-c06f485c-9abc-4b98-84e2-ea59524b92ac tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:16.590010 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-c06f485c-9abc-4b98-84e2-ea59524b92ac tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:16.597259 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c06f485c-9abc-4b98-84e2-ea59524b92ac tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:16.598070 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c06f485c-9abc-4b98-84e2-ea59524b92ac tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:16.599115 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c06f485c-9abc-4b98-84e2-ea59524b92ac tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:16.599936 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c06f485c-9abc-4b98-84e2-ea59524b92ac tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:16.750278 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-c06f485c-9abc-4b98-84e2-ea59524b92ac tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:16.760157 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-c06f485c-9abc-4b98-84e2-ea59524b92ac tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1522 microversion: 2.1 time: 0.176372 Jun 03 09:58:16.771693 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 120/213] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:16 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:17.779658 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-e391f0a1-d600-460d-8224-8af94ac001e0 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:17.782052 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-e391f0a1-d600-460d-8224-8af94ac001e0 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:17.791907 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e391f0a1-d600-460d-8224-8af94ac001e0 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:17.793034 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e391f0a1-d600-460d-8224-8af94ac001e0 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:17.794157 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e391f0a1-d600-460d-8224-8af94ac001e0 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:17.795012 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e391f0a1-d600-460d-8224-8af94ac001e0 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:17.969802 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-e391f0a1-d600-460d-8224-8af94ac001e0 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:17.980967 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-e391f0a1-d600-460d-8224-8af94ac001e0 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1522 microversion: 2.1 time: 0.205884 Jun 03 09:58:17.981574 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 94/214] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:17 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:18.191602 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-925c5a86-bbd2-4ee9-b43b-54369cb09051 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:18.192133 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-925c5a86-bbd2-4ee9-b43b-54369cb09051 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] [instance: 85a66cd0-df20-4640-849b-73f7f01329b9] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:18.198263 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-925c5a86-bbd2-4ee9-b43b-54369cb09051 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:18.198713 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-925c5a86-bbd2-4ee9-b43b-54369cb09051 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:18.199487 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-925c5a86-bbd2-4ee9-b43b-54369cb09051 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:18.199926 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-925c5a86-bbd2-4ee9-b43b-54369cb09051 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:18.214234 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.wsgi [None req-925c5a86-bbd2-4ee9-b43b-54369cb09051 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] HTTP exception thrown: Instance 85a66cd0-df20-4640-849b-73f7f01329b9 could not be found. Jun 03 09:58:18.215779 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-925c5a86-bbd2-4ee9-b43b-54369cb09051 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Request method failure captured: Jun 03 09:58:18.215779 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: request: DELETE /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9 HTTP/1.1 Jun 03 09:58:18.215779 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Accept: application/json Jun 03 09:58:18.215779 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Accept-Encoding: identity Jun 03 09:58:18.215779 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Connection: close Jun 03 09:58:18.215779 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Content-Length: 0 Jun 03 09:58:18.215779 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Content-Type: application/json Jun 03 09:58:18.215779 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Host: 10.222.0.45 Jun 03 09:58:18.215779 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Openstack-System-Scope: None Jun 03 09:58:18.215779 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: User-Agent: python-urllib3/1.26.9 Jun 03 09:58:18.215779 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Auth-Token: gAAAAABimdrYCpQwNEBKNY_u07oLFtgeGOEZmK1rFDAvEXyFwSWAtev7iWIgetSL7hmQ0vQKa-9xWGtTGTJpCJWJH-Hyn6gO_vamG3wWizmlBrmmhkfXKxCHnxK92Iubp2KlNPYEi5QVR9MXinhCAKGLfeT5yGEEJYPlL10yJJr5SlCLwN74SSk Jun 03 09:58:18.215779 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Domain-Id: None Jun 03 09:58:18.215779 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Domain-Name: None Jun 03 09:58:18.215779 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Identity-Status: Confirmed Jun 03 09:58:18.215779 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Is-Admin-Project: True Jun 03 09:58:18.215779 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Domain-Id: default Jun 03 09:58:18.215779 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Domain-Name: Default Jun 03 09:58:18.215779 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Id: ae18a142aa2049ffa07fc6516203f6fe Jun 03 09:58:18.215779 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Name: tempest-DeleteServersTestJSON-200873024 Jun 03 09:58:18.215779 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Role: member,reader Jun 03 09:58:18.215779 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Roles: member,reader Jun 03 09:58:18.217219 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ae18a142aa2049ffa07fc6516203f6fe", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ae18a142aa2049ffa07fc6516203f6fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ae18a142aa2049ffa07fc6516203f6fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ae18a142aa2049ffa07fc6516203f6fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 09:58:18.217219 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant: tempest-DeleteServersTestJSON-200873024 Jun 03 09:58:18.217219 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant-Id: ae18a142aa2049ffa07fc6516203f6fe Jun 03 09:58:18.217219 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant-Name: tempest-DeleteServersTestJSON-200873024 Jun 03 09:58:18.217219 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User: tempest-DeleteServersTestJSON-200873024-project Jun 03 09:58:18.217219 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Domain-Id: default Jun 03 09:58:18.217219 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Domain-Name: Default Jun 03 09:58:18.217219 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Id: c2e257ae4e744dd8a0553b7c2abee529 Jun 03 09:58:18.217219 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Name: tempest-DeleteServersTestJSON-200873024-project Jun 03 09:58:18.217219 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: method: > Jun 03 09:58:18.217219 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: exception: Instance 85a66cd0-df20-4640-849b-73f7f01329b9 could not be found. Jun 03 09:58:18.217219 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: action_args: {'id': '85a66cd0-df20-4640-849b-73f7f01329b9'} Jun 03 09:58:18.217996 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:58:18.217996 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:58:18.217996 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 09:58:18.217996 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 09:58:18.217996 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 09:58:18.217996 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 09:58:18.217996 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 09:58:18.217996 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 09:58:18.217996 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 09:58:18.217996 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 09:58:18.217996 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85a66cd0-df20-4640-849b-73f7f01329b9 could not be found. Jun 03 09:58:18.217996 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 09:58:18.217996 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:58:18.217996 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 09:58:18.217996 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:58:18.217996 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:58:18.217996 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:58:18.217996 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:58:18.217996 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:58:18.217996 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:58:18.219886 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:58:18.219886 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 09:58:18.219886 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 09:58:18.219886 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 09:58:18.219886 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 09:58:18.219886 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 09:58:18.219886 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 09:58:18.219886 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 09:58:18.219886 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:58:18.219886 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85a66cd0-df20-4640-849b-73f7f01329b9 could not be found. Jun 03 09:58:18.219886 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 09:58:18.219886 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:58:18.219886 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 09:58:18.219886 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:58:18.219886 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:58:18.219886 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:58:18.219886 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:58:18.219886 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:58:18.219886 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85a66cd0-df20-4640-849b-73f7f01329b9 could not be found. Jun 03 09:58:18.219886 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 09:58:18.221308 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-925c5a86-bbd2-4ee9-b43b-54369cb09051 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Returning 404 to user: Instance 85a66cd0-df20-4640-849b-73f7f01329b9 could not be found. {{(pid=117647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:58:18.221308 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-925c5a86-bbd2-4ee9-b43b-54369cb09051 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] 10.222.0.45 "DELETE /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9" status: 404 len: 111 microversion: 2.1 time: 0.029482 Jun 03 09:58:18.221308 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 121/215] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jun 3 09:58:18 2022] DELETE /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:58:18.231726 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-6841cf5e-7334-4776-b661-fcaf48102105 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:18.232947 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-6841cf5e-7334-4776-b661-fcaf48102105 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] [instance: 85a66cd0-df20-4640-849b-73f7f01329b9] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:18.239548 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6841cf5e-7334-4776-b661-fcaf48102105 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:18.240053 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6841cf5e-7334-4776-b661-fcaf48102105 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:18.241035 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6841cf5e-7334-4776-b661-fcaf48102105 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:18.241477 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6841cf5e-7334-4776-b661-fcaf48102105 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:18.255097 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.wsgi [None req-6841cf5e-7334-4776-b661-fcaf48102105 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] HTTP exception thrown: Instance 85a66cd0-df20-4640-849b-73f7f01329b9 could not be found. Jun 03 09:58:18.257474 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-6841cf5e-7334-4776-b661-fcaf48102105 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Request method failure captured: Jun 03 09:58:18.257474 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: request: GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9 HTTP/1.1 Jun 03 09:58:18.257474 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept: application/json Jun 03 09:58:18.257474 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept-Encoding: identity Jun 03 09:58:18.257474 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Connection: close Jun 03 09:58:18.257474 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Length: 0 Jun 03 09:58:18.257474 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Type: application/json Jun 03 09:58:18.257474 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Host: 10.222.0.45 Jun 03 09:58:18.257474 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Openstack-System-Scope: None Jun 03 09:58:18.257474 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: User-Agent: python-urllib3/1.26.9 Jun 03 09:58:18.257474 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Auth-Token: gAAAAABimdrYCpQwNEBKNY_u07oLFtgeGOEZmK1rFDAvEXyFwSWAtev7iWIgetSL7hmQ0vQKa-9xWGtTGTJpCJWJH-Hyn6gO_vamG3wWizmlBrmmhkfXKxCHnxK92Iubp2KlNPYEi5QVR9MXinhCAKGLfeT5yGEEJYPlL10yJJr5SlCLwN74SSk Jun 03 09:58:18.257474 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Id: None Jun 03 09:58:18.257474 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Name: None Jun 03 09:58:18.257474 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Identity-Status: Confirmed Jun 03 09:58:18.257474 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Is-Admin-Project: True Jun 03 09:58:18.257474 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Id: default Jun 03 09:58:18.257474 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Name: Default Jun 03 09:58:18.257474 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Id: ae18a142aa2049ffa07fc6516203f6fe Jun 03 09:58:18.257474 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Name: tempest-DeleteServersTestJSON-200873024 Jun 03 09:58:18.257474 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Role: member,reader Jun 03 09:58:18.257474 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Roles: member,reader Jun 03 09:58:18.258892 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_ae18a142aa2049ffa07fc6516203f6fe", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/ae18a142aa2049ffa07fc6516203f6fe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ae18a142aa2049ffa07fc6516203f6fe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/ae18a142aa2049ffa07fc6516203f6fe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 09:58:18.258892 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant: tempest-DeleteServersTestJSON-200873024 Jun 03 09:58:18.258892 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Id: ae18a142aa2049ffa07fc6516203f6fe Jun 03 09:58:18.258892 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Name: tempest-DeleteServersTestJSON-200873024 Jun 03 09:58:18.258892 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User: tempest-DeleteServersTestJSON-200873024-project Jun 03 09:58:18.258892 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Id: default Jun 03 09:58:18.258892 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Name: Default Jun 03 09:58:18.258892 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Id: c2e257ae4e744dd8a0553b7c2abee529 Jun 03 09:58:18.258892 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Name: tempest-DeleteServersTestJSON-200873024-project Jun 03 09:58:18.258892 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: method: > Jun 03 09:58:18.258892 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: exception: Instance 85a66cd0-df20-4640-849b-73f7f01329b9 could not be found. Jun 03 09:58:18.258892 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: action_args: {'id': '85a66cd0-df20-4640-849b-73f7f01329b9'} Jun 03 09:58:18.259798 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:58:18.259798 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:58:18.259798 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 09:58:18.259798 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 09:58:18.259798 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 09:58:18.259798 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 09:58:18.259798 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 09:58:18.259798 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 09:58:18.259798 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 09:58:18.259798 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 09:58:18.259798 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85a66cd0-df20-4640-849b-73f7f01329b9 could not be found. Jun 03 09:58:18.259798 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 09:58:18.259798 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:58:18.259798 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 09:58:18.259798 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:58:18.259798 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:58:18.259798 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:58:18.259798 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:58:18.259798 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:58:18.259798 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:58:18.261319 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:58:18.261319 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 09:58:18.261319 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 09:58:18.261319 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 09:58:18.261319 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 09:58:18.261319 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 09:58:18.261319 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 09:58:18.261319 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85a66cd0-df20-4640-849b-73f7f01329b9 could not be found. Jun 03 09:58:18.261319 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 09:58:18.261319 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:58:18.261319 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 09:58:18.261319 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:58:18.261319 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:58:18.261319 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:58:18.261319 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:58:18.261319 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:58:18.261319 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85a66cd0-df20-4640-849b-73f7f01329b9 could not be found. Jun 03 09:58:18.261319 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 09:58:18.263110 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-6841cf5e-7334-4776-b661-fcaf48102105 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] Returning 404 to user: Instance 85a66cd0-df20-4640-849b-73f7f01329b9 could not be found. {{(pid=117648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:58:18.264100 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-6841cf5e-7334-4776-b661-fcaf48102105 tempest-DeleteServersTestJSON-200873024 tempest-DeleteServersTestJSON-200873024-project] 10.222.0.45 "GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9" status: 404 len: 111 microversion: 2.1 time: 0.040151 Jun 03 09:58:18.265111 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 95/216] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:18 2022] GET /compute/v2.1/servers/85a66cd0-df20-4640-849b-73f7f01329b9 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 09:58:18.998713 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-d35726c2-c399-47ca-bba9-7370b08bcbf7 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:18.999328 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-d35726c2-c399-47ca-bba9-7370b08bcbf7 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:19.008283 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d35726c2-c399-47ca-bba9-7370b08bcbf7 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:19.010664 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d35726c2-c399-47ca-bba9-7370b08bcbf7 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:19.011800 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d35726c2-c399-47ca-bba9-7370b08bcbf7 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:19.013877 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d35726c2-c399-47ca-bba9-7370b08bcbf7 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:19.200648 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-d35726c2-c399-47ca-bba9-7370b08bcbf7 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:19.208672 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-d35726c2-c399-47ca-bba9-7370b08bcbf7 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1522 microversion: 2.1 time: 0.213761 Jun 03 09:58:19.209256 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 122/217] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:18 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:20.226705 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-66de4cd1-5556-46a4-8d4f-236f7c2348c5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:20.227654 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-66de4cd1-5556-46a4-8d4f-236f7c2348c5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:20.234803 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-66de4cd1-5556-46a4-8d4f-236f7c2348c5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:20.235282 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-66de4cd1-5556-46a4-8d4f-236f7c2348c5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:20.236060 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-66de4cd1-5556-46a4-8d4f-236f7c2348c5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:20.236501 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-66de4cd1-5556-46a4-8d4f-236f7c2348c5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:20.366663 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-66de4cd1-5556-46a4-8d4f-236f7c2348c5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:20.374129 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-66de4cd1-5556-46a4-8d4f-236f7c2348c5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1522 microversion: 2.1 time: 0.152773 Jun 03 09:58:20.375034 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 96/218] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:20 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:21.390901 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-c0fa4ba1-17c1-4bd4-92c2-ff448948f8d2 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:21.391519 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-c0fa4ba1-17c1-4bd4-92c2-ff448948f8d2 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:21.397694 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c0fa4ba1-17c1-4bd4-92c2-ff448948f8d2 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:21.398211 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c0fa4ba1-17c1-4bd4-92c2-ff448948f8d2 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:21.398974 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c0fa4ba1-17c1-4bd4-92c2-ff448948f8d2 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:21.399412 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c0fa4ba1-17c1-4bd4-92c2-ff448948f8d2 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:21.527193 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-c0fa4ba1-17c1-4bd4-92c2-ff448948f8d2 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:21.535594 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-c0fa4ba1-17c1-4bd4-92c2-ff448948f8d2 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1522 microversion: 2.1 time: 0.148660 Jun 03 09:58:21.536162 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 123/219] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:21 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:22.567367 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-4449d1e8-bcc3-4cfb-a50e-4acc655b95f6 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:22.568499 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-4449d1e8-bcc3-4cfb-a50e-4acc655b95f6 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:22.571973 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_api:SELECT=41 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:22.582111 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4449d1e8-bcc3-4cfb-a50e-4acc655b95f6 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:22.582934 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4449d1e8-bcc3-4cfb-a50e-4acc655b95f6 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:22.585589 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4449d1e8-bcc3-4cfb-a50e-4acc655b95f6 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:22.586592 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4449d1e8-bcc3-4cfb-a50e-4acc655b95f6 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:22.817181 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-4449d1e8-bcc3-4cfb-a50e-4acc655b95f6 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:22.825102 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-4449d1e8-bcc3-4cfb-a50e-4acc655b95f6 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1522 microversion: 2.1 time: 0.272792 Jun 03 09:58:22.825772 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 97/220] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:22 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:23.846866 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-8864bcca-840f-4468-a7d8-3cb9b5080ce9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:23.848319 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-8864bcca-840f-4468-a7d8-3cb9b5080ce9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:23.859279 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8864bcca-840f-4468-a7d8-3cb9b5080ce9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:23.860935 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8864bcca-840f-4468-a7d8-3cb9b5080ce9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:23.862428 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8864bcca-840f-4468-a7d8-3cb9b5080ce9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:23.863476 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8864bcca-840f-4468-a7d8-3cb9b5080ce9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:24.063277 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-8864bcca-840f-4468-a7d8-3cb9b5080ce9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:24.074795 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-8864bcca-840f-4468-a7d8-3cb9b5080ce9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1522 microversion: 2.1 time: 0.232602 Jun 03 09:58:24.075524 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 124/221] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:23 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:58:25.092390 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-1a46e3a6-1ffd-4c63-82ae-bffca565a7c9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:25.093012 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-1a46e3a6-1ffd-4c63-82ae-bffca565a7c9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:25.106743 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1a46e3a6-1ffd-4c63-82ae-bffca565a7c9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:25.107398 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1a46e3a6-1ffd-4c63-82ae-bffca565a7c9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:25.108189 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1a46e3a6-1ffd-4c63-82ae-bffca565a7c9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:25.108630 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1a46e3a6-1ffd-4c63-82ae-bffca565a7c9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:25.310128 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-1a46e3a6-1ffd-4c63-82ae-bffca565a7c9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:25.319318 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-1a46e3a6-1ffd-4c63-82ae-bffca565a7c9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1522 microversion: 2.1 time: 0.231166 Jun 03 09:58:25.320233 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 98/222] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:25 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:26.336395 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-a16958ca-d46c-4e3e-b5ea-fe30fbc2bd1d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:26.337611 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-a16958ca-d46c-4e3e-b5ea-fe30fbc2bd1d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:26.343882 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a16958ca-d46c-4e3e-b5ea-fe30fbc2bd1d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:26.344439 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a16958ca-d46c-4e3e-b5ea-fe30fbc2bd1d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:26.345997 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a16958ca-d46c-4e3e-b5ea-fe30fbc2bd1d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:26.346575 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a16958ca-d46c-4e3e-b5ea-fe30fbc2bd1d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:26.515581 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-a16958ca-d46c-4e3e-b5ea-fe30fbc2bd1d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:26.524808 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-a16958ca-d46c-4e3e-b5ea-fe30fbc2bd1d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1522 microversion: 2.1 time: 0.192164 Jun 03 09:58:26.526178 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 125/223] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:26 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:27.545156 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-c3fb711c-822c-479f-96df-02f3524d8122 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:27.545789 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-c3fb711c-822c-479f-96df-02f3524d8122 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:27.554148 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c3fb711c-822c-479f-96df-02f3524d8122 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:27.554607 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c3fb711c-822c-479f-96df-02f3524d8122 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:27.555561 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c3fb711c-822c-479f-96df-02f3524d8122 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:27.556162 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c3fb711c-822c-479f-96df-02f3524d8122 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:27.774413 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-c3fb711c-822c-479f-96df-02f3524d8122 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:27.789309 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-c3fb711c-822c-479f-96df-02f3524d8122 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1522 microversion: 2.1 time: 0.248798 Jun 03 09:58:27.801122 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 99/224] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:27 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1522 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:28.811812 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-cf44fc90-a304-4bc8-89aa-d0af535e9d4f tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:28.815546 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-cf44fc90-a304-4bc8-89aa-d0af535e9d4f tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:28.847708 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cf44fc90-a304-4bc8-89aa-d0af535e9d4f tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:28.848174 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cf44fc90-a304-4bc8-89aa-d0af535e9d4f tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:28.853470 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cf44fc90-a304-4bc8-89aa-d0af535e9d4f tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:28.855024 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cf44fc90-a304-4bc8-89aa-d0af535e9d4f tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:29.035932 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-cf44fc90-a304-4bc8-89aa-d0af535e9d4f tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:29.044453 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-cf44fc90-a304-4bc8-89aa-d0af535e9d4f tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1522 microversion: 2.1 time: 0.239413 Jun 03 09:58:29.045530 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 126/225] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:28 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:30.062208 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-a3e16eab-037c-4086-a79e-041706e03a7f tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:30.062862 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-a3e16eab-037c-4086-a79e-041706e03a7f tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:30.079583 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a3e16eab-037c-4086-a79e-041706e03a7f tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:30.082346 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a3e16eab-037c-4086-a79e-041706e03a7f tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:30.083447 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a3e16eab-037c-4086-a79e-041706e03a7f tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:30.083778 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a3e16eab-037c-4086-a79e-041706e03a7f tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:30.571061 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-a3e16eab-037c-4086-a79e-041706e03a7f tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:30.583841 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-a3e16eab-037c-4086-a79e-041706e03a7f tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1522 microversion: 2.1 time: 0.524942 Jun 03 09:58:30.584434 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 100/226] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:30 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1522 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:31.606691 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-95864b2f-be79-4483-8823-aa5f645f0301 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:31.607324 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-95864b2f-be79-4483-8823-aa5f645f0301 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:31.632336 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-95864b2f-be79-4483-8823-aa5f645f0301 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:31.633181 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-95864b2f-be79-4483-8823-aa5f645f0301 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:31.634367 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-95864b2f-be79-4483-8823-aa5f645f0301 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:31.634910 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-95864b2f-be79-4483-8823-aa5f645f0301 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:31.957728 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-95864b2f-be79-4483-8823-aa5f645f0301 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:31.965794 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-95864b2f-be79-4483-8823-aa5f645f0301 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1522 microversion: 2.1 time: 0.367157 Jun 03 09:58:31.969351 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 127/227] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:31 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1522 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:32.985205 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-fc427ed3-08d0-4bdd-82db-8be50018eacf tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:32.986191 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-fc427ed3-08d0-4bdd-82db-8be50018eacf tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:32.993388 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fc427ed3-08d0-4bdd-82db-8be50018eacf tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:32.993866 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fc427ed3-08d0-4bdd-82db-8be50018eacf tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:32.994639 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fc427ed3-08d0-4bdd-82db-8be50018eacf tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:32.995074 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fc427ed3-08d0-4bdd-82db-8be50018eacf tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:33.269195 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-fc427ed3-08d0-4bdd-82db-8be50018eacf tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:33.290753 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-fc427ed3-08d0-4bdd-82db-8be50018eacf tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1522 microversion: 2.1 time: 0.310011 Jun 03 09:58:33.303626 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 101/228] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:32 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1522 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:58:34.313041 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-b2213834-9042-415b-a73f-b6ed75fa0a3c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:34.314766 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-b2213834-9042-415b-a73f-b6ed75fa0a3c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:34.327333 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b2213834-9042-415b-a73f-b6ed75fa0a3c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:34.328117 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b2213834-9042-415b-a73f-b6ed75fa0a3c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:34.330591 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b2213834-9042-415b-a73f-b6ed75fa0a3c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:34.331818 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b2213834-9042-415b-a73f-b6ed75fa0a3c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:34.671561 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-b2213834-9042-415b-a73f-b6ed75fa0a3c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:34.680852 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-b2213834-9042-415b-a73f-b6ed75fa0a3c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1522 microversion: 2.1 time: 0.375389 Jun 03 09:58:34.682037 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 128/229] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:34 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1522 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:35.698335 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-b62321c1-9c37-45dd-bfae-ce1c2c224d92 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:35.699001 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-b62321c1-9c37-45dd-bfae-ce1c2c224d92 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:35.717561 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b62321c1-9c37-45dd-bfae-ce1c2c224d92 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:35.718048 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b62321c1-9c37-45dd-bfae-ce1c2c224d92 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:35.719114 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b62321c1-9c37-45dd-bfae-ce1c2c224d92 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:35.719561 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b62321c1-9c37-45dd-bfae-ce1c2c224d92 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:36.086876 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-b62321c1-9c37-45dd-bfae-ce1c2c224d92 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:36.098876 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-b62321c1-9c37-45dd-bfae-ce1c2c224d92 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1502 microversion: 2.1 time: 0.404441 Jun 03 09:58:36.106333 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 102/230] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:35 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1502 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:36.123172 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-b177c5ad-d62b-43c5-92eb-ccc1df53012b tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:36.123854 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-b177c5ad-d62b-43c5-92eb-ccc1df53012b tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 59f3fa08-01f7-45d5-ae2b-171882dbc9c5] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:36.133118 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b177c5ad-d62b-43c5-92eb-ccc1df53012b tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:36.135762 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b177c5ad-d62b-43c5-92eb-ccc1df53012b tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:36.136578 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b177c5ad-d62b-43c5-92eb-ccc1df53012b tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:36.137032 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b177c5ad-d62b-43c5-92eb-ccc1df53012b tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:36.193564 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:36.553433 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-b177c5ad-d62b-43c5-92eb-ccc1df53012b tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:36.569081 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-b177c5ad-d62b-43c5-92eb-ccc1df53012b tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5" status: 200 len: 1514 microversion: 2.1 time: 0.449930 Jun 03 09:58:36.570028 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 129/231] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:36 2022] GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5 => generated 1514 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:41.967281 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-9c5228b8-e577-4729-a0c6-588201243dc7 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:58:41.968245 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-9c5228b8-e577-4729-a0c6-588201243dc7 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 59f3fa08-01f7-45d5-ae2b-171882dbc9c5] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:41.991207 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9c5228b8-e577-4729-a0c6-588201243dc7 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:41.994677 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9c5228b8-e577-4729-a0c6-588201243dc7 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:41.995668 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9c5228b8-e577-4729-a0c6-588201243dc7 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:41.996542 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9c5228b8-e577-4729-a0c6-588201243dc7 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:42.072908 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.objects.instance [None req-9c5228b8-e577-4729-a0c6-588201243dc7 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lazy-loading 'flavor' on Instance uuid 59f3fa08-01f7-45d5-ae2b-171882dbc9c5 {{(pid=117648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 09:58:42.349134 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-9c5228b8-e577-4729-a0c6-588201243dc7 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "POST /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5/action" status: 200 len: 32 microversion: 2.1 time: 0.386275 Jun 03 09:58:42.352621 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 103/232] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jun 3 09:58:41 2022] POST /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5/action => generated 32 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 09:58:42.363329 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-e91b40ec-6b6c-4883-aa41-968eda66baf0 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:42.363896 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-e91b40ec-6b6c-4883-aa41-968eda66baf0 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 59f3fa08-01f7-45d5-ae2b-171882dbc9c5] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:42.369088 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_api:SELECT=32 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:42.391905 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e91b40ec-6b6c-4883-aa41-968eda66baf0 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:42.397726 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e91b40ec-6b6c-4883-aa41-968eda66baf0 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:42.399496 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e91b40ec-6b6c-4883-aa41-968eda66baf0 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:42.400985 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e91b40ec-6b6c-4883-aa41-968eda66baf0 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:42.859171 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-e91b40ec-6b6c-4883-aa41-968eda66baf0 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:42.874265 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-e91b40ec-6b6c-4883-aa41-968eda66baf0 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5" status: 200 len: 1520 microversion: 2.1 time: 0.515204 Jun 03 09:58:42.884950 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 130/233] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:42 2022] GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5 => generated 1520 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:43.893014 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-4f5e77ee-8c92-4bec-9972-dd90336ac06c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:43.893730 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-4f5e77ee-8c92-4bec-9972-dd90336ac06c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 59f3fa08-01f7-45d5-ae2b-171882dbc9c5] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:43.915521 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4f5e77ee-8c92-4bec-9972-dd90336ac06c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:43.916075 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4f5e77ee-8c92-4bec-9972-dd90336ac06c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:43.916909 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4f5e77ee-8c92-4bec-9972-dd90336ac06c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:43.917350 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4f5e77ee-8c92-4bec-9972-dd90336ac06c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:44.359031 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-4f5e77ee-8c92-4bec-9972-dd90336ac06c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:44.371277 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-4f5e77ee-8c92-4bec-9972-dd90336ac06c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5" status: 200 len: 1520 microversion: 2.1 time: 0.483077 Jun 03 09:58:44.386610 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 104/234] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:43 2022] GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5 => generated 1520 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:45.393271 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-89f58d43-fd70-4b3c-9777-a9bce799673e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:45.395203 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-89f58d43-fd70-4b3c-9777-a9bce799673e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 59f3fa08-01f7-45d5-ae2b-171882dbc9c5] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:45.408932 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-89f58d43-fd70-4b3c-9777-a9bce799673e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:45.416802 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-89f58d43-fd70-4b3c-9777-a9bce799673e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:45.420636 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-89f58d43-fd70-4b3c-9777-a9bce799673e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:45.423164 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-89f58d43-fd70-4b3c-9777-a9bce799673e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:45.671448 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-89f58d43-fd70-4b3c-9777-a9bce799673e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:45.682327 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-89f58d43-fd70-4b3c-9777-a9bce799673e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5" status: 200 len: 1520 microversion: 2.1 time: 0.295856 Jun 03 09:58:45.686821 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 131/235] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:45 2022] GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5 => generated 1520 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:46.703714 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-63eaf4e5-aee8-4c4a-b324-6fd58ae29db5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:46.704380 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-63eaf4e5-aee8-4c4a-b324-6fd58ae29db5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 59f3fa08-01f7-45d5-ae2b-171882dbc9c5] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:46.712516 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-63eaf4e5-aee8-4c4a-b324-6fd58ae29db5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:46.713000 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-63eaf4e5-aee8-4c4a-b324-6fd58ae29db5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:46.713742 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-63eaf4e5-aee8-4c4a-b324-6fd58ae29db5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:46.716694 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-63eaf4e5-aee8-4c4a-b324-6fd58ae29db5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:46.726746 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:47.133982 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-63eaf4e5-aee8-4c4a-b324-6fd58ae29db5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:47.151971 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-63eaf4e5-aee8-4c4a-b324-6fd58ae29db5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5" status: 200 len: 1520 microversion: 2.1 time: 0.452906 Jun 03 09:58:47.153220 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 105/236] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:46 2022] GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5 => generated 1520 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:48.172247 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-1137bedf-06ff-438a-ab3f-44e98ebb711d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:48.177677 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-1137bedf-06ff-438a-ab3f-44e98ebb711d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 59f3fa08-01f7-45d5-ae2b-171882dbc9c5] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:48.193995 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1137bedf-06ff-438a-ab3f-44e98ebb711d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:48.194452 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1137bedf-06ff-438a-ab3f-44e98ebb711d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:48.199757 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1137bedf-06ff-438a-ab3f-44e98ebb711d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:48.200224 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1137bedf-06ff-438a-ab3f-44e98ebb711d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:48.925066 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-1137bedf-06ff-438a-ab3f-44e98ebb711d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:48.937209 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-1137bedf-06ff-438a-ab3f-44e98ebb711d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5" status: 200 len: 1520 microversion: 2.1 time: 0.771688 Jun 03 09:58:48.937906 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 132/237] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:48 2022] GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5 => generated 1520 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:49.953986 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-4dbf6b85-887e-4884-b51c-e1f3228922a9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:49.955909 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-4dbf6b85-887e-4884-b51c-e1f3228922a9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 59f3fa08-01f7-45d5-ae2b-171882dbc9c5] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:49.975872 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4dbf6b85-887e-4884-b51c-e1f3228922a9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:49.976412 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4dbf6b85-887e-4884-b51c-e1f3228922a9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:49.977276 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4dbf6b85-887e-4884-b51c-e1f3228922a9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:49.977824 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4dbf6b85-887e-4884-b51c-e1f3228922a9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:50.374523 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-4dbf6b85-887e-4884-b51c-e1f3228922a9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:50.421887 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-4dbf6b85-887e-4884-b51c-e1f3228922a9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5" status: 200 len: 1520 microversion: 2.1 time: 0.471088 Jun 03 09:58:50.424223 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 106/238] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:49 2022] GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5 => generated 1520 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:51.439972 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-d3f9c2cf-2907-4762-8fa6-b88926a7ced2 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:51.440684 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-d3f9c2cf-2907-4762-8fa6-b88926a7ced2 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 59f3fa08-01f7-45d5-ae2b-171882dbc9c5] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:51.454634 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d3f9c2cf-2907-4762-8fa6-b88926a7ced2 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:51.461658 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d3f9c2cf-2907-4762-8fa6-b88926a7ced2 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:51.463105 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d3f9c2cf-2907-4762-8fa6-b88926a7ced2 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:51.471117 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d3f9c2cf-2907-4762-8fa6-b88926a7ced2 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:51.740273 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-44ee2c77-7a58-481b-8642-60ba6a2100a7 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Action: 'create', calling method: .version_select at 0x7f5036d60dc0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1925739570", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHnxwu5lQ9ltN2qbx/Qr8yJFqykmzwLJ6oBW5gpFbGn/Op4MOFGMy7IFao8eqbMY6JN+NU/P4JDE8jh6NxHxyBUDFL+p+UESZHAfd1vpHpl+ZuyzlXiYYNRhi4CVkDsPkQ=="}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:58:51.774858 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-44ee2c77-7a58-481b-8642-60ba6a2100a7 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Getting quotas for project 8a878ecfb9cd47b684c027beb6ad0b03. Resources: {'key_pairs'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 09:58:51.776009 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d3f9c2cf-2907-4762-8fa6-b88926a7ced2 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:51.784228 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-44ee2c77-7a58-481b-8642-60ba6a2100a7 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Getting quotas for user 397ff11fedcc4d17867e1d9c10fcd10f and project 8a878ecfb9cd47b684c027beb6ad0b03. Resources: {'key_pairs'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 09:58:51.787782 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-d3f9c2cf-2907-4762-8fa6-b88926a7ced2 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5" status: 200 len: 1520 microversion: 2.1 time: 0.352567 Jun 03 09:58:51.802609 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 107/239] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:51 2022] GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5 => generated 1520 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:58:51.843505 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-44ee2c77-7a58-481b-8642-60ba6a2100a7 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.509840 Jun 03 09:58:51.849728 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 133/240] 10.222.0.45 () {60 vars in 1158 bytes} [Fri Jun 3 09:58:51 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:58:52.815768 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-6558fdf8-f82b-4bd6-836a-fae7cc31fa15 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:52.817163 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-6558fdf8-f82b-4bd6-836a-fae7cc31fa15 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 59f3fa08-01f7-45d5-ae2b-171882dbc9c5] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:52.824697 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_api:SELECT=22 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:58:52.831166 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6558fdf8-f82b-4bd6-836a-fae7cc31fa15 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:52.831973 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6558fdf8-f82b-4bd6-836a-fae7cc31fa15 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:52.832993 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6558fdf8-f82b-4bd6-836a-fae7cc31fa15 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:52.833848 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6558fdf8-f82b-4bd6-836a-fae7cc31fa15 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:53.094810 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-6558fdf8-f82b-4bd6-836a-fae7cc31fa15 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:53.104037 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-6558fdf8-f82b-4bd6-836a-fae7cc31fa15 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5" status: 200 len: 1520 microversion: 2.1 time: 0.294875 Jun 03 09:58:53.104630 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 108/241] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:52 2022] GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5 => generated 1520 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:54.125944 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-bcee8330-887c-4e75-8eea-c89a310616fc tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:54.127556 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-bcee8330-887c-4e75-8eea-c89a310616fc tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 59f3fa08-01f7-45d5-ae2b-171882dbc9c5] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:54.136436 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bcee8330-887c-4e75-8eea-c89a310616fc tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:54.137234 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bcee8330-887c-4e75-8eea-c89a310616fc tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:54.138172 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bcee8330-887c-4e75-8eea-c89a310616fc tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:54.138684 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bcee8330-887c-4e75-8eea-c89a310616fc tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:54.342433 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-bcee8330-887c-4e75-8eea-c89a310616fc tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:54.352456 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-bcee8330-887c-4e75-8eea-c89a310616fc tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5" status: 200 len: 1520 microversion: 2.1 time: 0.232773 Jun 03 09:58:54.356796 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 134/242] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:54 2022] GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5 => generated 1520 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:55.381195 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-e8bf979b-56c0-4857-9741-c4097bdc7354 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:55.382569 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-e8bf979b-56c0-4857-9741-c4097bdc7354 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 59f3fa08-01f7-45d5-ae2b-171882dbc9c5] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:55.398735 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e8bf979b-56c0-4857-9741-c4097bdc7354 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:55.414172 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e8bf979b-56c0-4857-9741-c4097bdc7354 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:55.415475 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e8bf979b-56c0-4857-9741-c4097bdc7354 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:55.417890 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e8bf979b-56c0-4857-9741-c4097bdc7354 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:55.625682 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-e8bf979b-56c0-4857-9741-c4097bdc7354 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:55.636192 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-e8bf979b-56c0-4857-9741-c4097bdc7354 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5" status: 200 len: 1520 microversion: 2.1 time: 0.270502 Jun 03 09:58:55.642241 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 109/243] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:55 2022] GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5 => generated 1520 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:56.661545 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-4627de02-772a-471b-9d52-c4d1783c7a60 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:56.663217 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-4627de02-772a-471b-9d52-c4d1783c7a60 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 59f3fa08-01f7-45d5-ae2b-171882dbc9c5] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:56.690693 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4627de02-772a-471b-9d52-c4d1783c7a60 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:56.691466 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4627de02-772a-471b-9d52-c4d1783c7a60 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:56.692496 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4627de02-772a-471b-9d52-c4d1783c7a60 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:56.694374 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4627de02-772a-471b-9d52-c4d1783c7a60 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:56.888269 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-4627de02-772a-471b-9d52-c4d1783c7a60 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:56.901190 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-4627de02-772a-471b-9d52-c4d1783c7a60 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5" status: 200 len: 1520 microversion: 2.1 time: 0.245748 Jun 03 09:58:56.905925 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 135/244] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:56 2022] GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5 => generated 1520 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:57.927040 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-b0b1471a-68d3-4a8d-9e1c-07815cd50d8d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:57.927771 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-b0b1471a-68d3-4a8d-9e1c-07815cd50d8d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 59f3fa08-01f7-45d5-ae2b-171882dbc9c5] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:57.935749 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b0b1471a-68d3-4a8d-9e1c-07815cd50d8d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:57.936261 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b0b1471a-68d3-4a8d-9e1c-07815cd50d8d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:57.937406 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b0b1471a-68d3-4a8d-9e1c-07815cd50d8d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:57.938006 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b0b1471a-68d3-4a8d-9e1c-07815cd50d8d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:58.122340 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-b0b1471a-68d3-4a8d-9e1c-07815cd50d8d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:58.131801 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-b0b1471a-68d3-4a8d-9e1c-07815cd50d8d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5" status: 200 len: 1520 microversion: 2.1 time: 0.212656 Jun 03 09:58:58.133122 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 110/245] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:57 2022] GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5 => generated 1520 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:58:58.644236 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-76397167-fa55-4de5-bcdf-674f082902e6 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Action: 'create', calling method: .version_select at 0x7f5036d605e0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-781155472", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKIBqf91ecorFqz3B8BMelwNSKE2uIw60CIPn1qYe4AA0850TAAqhJP5+FrUIvQmWMvaSQOJJ+e2ZQ6Z9H86nvVq+dQskHqQ+Jxd0Tr5BXI5L+Heaj5a8aMlyfw74B+GyQ=="}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:58:58.662711 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-76397167-fa55-4de5-bcdf-674f082902e6 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Getting quotas for project d3c4a1843a98436c81df8111244795ac. Resources: {'key_pairs'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 09:58:58.667813 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-76397167-fa55-4de5-bcdf-674f082902e6 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Getting quotas for user 7f67bf225f3a4ac5bcf07dde077101fd and project d3c4a1843a98436c81df8111244795ac. Resources: {'key_pairs'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 09:58:58.695151 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-76397167-fa55-4de5-bcdf-674f082902e6 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.055527 Jun 03 09:58:58.695745 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 136/246] 10.222.0.45 () {60 vars in 1158 bytes} [Fri Jun 3 09:58:58 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:58:58.823191 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-07491a86-e62a-46ea-a08d-4b237a0d6855 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-705075244", "imageRef": "120c3082-5a36-4e34-89f3-80bd7dd5d290", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-781155472", "networks": [{"uuid": "6b928ccb-bf30-4a4e-980a-0e5ac07ba476"}]}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:58:58.873612 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.network.neutron [None req-07491a86-e62a-46ea-a08d-4b237a0d6855 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] validate_networks() for [('6b928ccb-bf30-4a4e-980a-0e5ac07ba476', None, None, None, None, None)] {{(pid=117648) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 09:58:59.149681 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-aae998f4-5ba3-49d6-bc67-f6c1d8b16a20 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:59.150594 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-aae998f4-5ba3-49d6-bc67-f6c1d8b16a20 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 59f3fa08-01f7-45d5-ae2b-171882dbc9c5] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:59.157583 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-aae998f4-5ba3-49d6-bc67-f6c1d8b16a20 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:59.158051 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-aae998f4-5ba3-49d6-bc67-f6c1d8b16a20 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:59.158849 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-aae998f4-5ba3-49d6-bc67-f6c1d8b16a20 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:59.159667 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-aae998f4-5ba3-49d6-bc67-f6c1d8b16a20 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:59.325008 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-07491a86-e62a-46ea-a08d-4b237a0d6855 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Flavor limits 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 09:58:59.325505 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-07491a86-e62a-46ea-a08d-4b237a0d6855 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Image limits 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 09:58:59.326038 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-07491a86-e62a-46ea-a08d-4b237a0d6855 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Flavor pref 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 09:58:59.326557 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-07491a86-e62a-46ea-a08d-4b237a0d6855 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Image pref 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 09:58:59.327028 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-07491a86-e62a-46ea-a08d-4b237a0d6855 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 09:58:59.336238 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-07491a86-e62a-46ea-a08d-4b237a0d6855 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:59.336760 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-07491a86-e62a-46ea-a08d-4b237a0d6855 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:59.337614 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-07491a86-e62a-46ea-a08d-4b237a0d6855 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:58:59.338083 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-07491a86-e62a-46ea-a08d-4b237a0d6855 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:58:59.355899 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-07491a86-e62a-46ea-a08d-4b237a0d6855 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Getting quotas for project d3c4a1843a98436c81df8111244795ac. Resources: {'ram', 'cores', 'instances'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 09:58:59.356983 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-aae998f4-5ba3-49d6-bc67-f6c1d8b16a20 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:59.360534 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-07491a86-e62a-46ea-a08d-4b237a0d6855 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Getting quotas for user 7f67bf225f3a4ac5bcf07dde077101fd and project d3c4a1843a98436c81df8111244795ac. Resources: {'ram', 'cores', 'instances'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 09:58:59.366026 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-aae998f4-5ba3-49d6-bc67-f6c1d8b16a20 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5" status: 200 len: 1520 microversion: 2.1 time: 0.220942 Jun 03 09:58:59.366619 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 137/247] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:59 2022] GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5 => generated 1520 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:58:59.372570 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-07491a86-e62a-46ea-a08d-4b237a0d6855 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Going to run 1 instances... {{(pid=117648) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 09:58:59.374822 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-07491a86-e62a-46ea-a08d-4b237a0d6855 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='120c3082-5a36-4e34-89f3-80bd7dd5d290',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 09:58:59.428256 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-07491a86-e62a-46ea-a08d-4b237a0d6855 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.608905 Jun 03 09:58:59.428966 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 111/248] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jun 3 09:58:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 09:58:59.438677 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-6486fa8b-706c-4698-afcc-cb388756b13c tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:58:59.439298 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-6486fa8b-706c-4698-afcc-cb388756b13c tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:58:59.492551 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-6486fa8b-706c-4698-afcc-cb388756b13c tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:58:59.499266 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-6486fa8b-706c-4698-afcc-cb388756b13c tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1257 microversion: 2.1 time: 0.064390 Jun 03 09:58:59.499890 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 138/249] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:58:59 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1257 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:00.386424 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-f171bdbf-a24f-45b0-8f40-5fdf170d5a18 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:00.387191 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-f171bdbf-a24f-45b0-8f40-5fdf170d5a18 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 59f3fa08-01f7-45d5-ae2b-171882dbc9c5] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:00.395331 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f171bdbf-a24f-45b0-8f40-5fdf170d5a18 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:00.395847 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f171bdbf-a24f-45b0-8f40-5fdf170d5a18 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:00.396723 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f171bdbf-a24f-45b0-8f40-5fdf170d5a18 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:00.397159 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f171bdbf-a24f-45b0-8f40-5fdf170d5a18 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:00.516549 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-3cb0ade7-4ffe-4b9d-a48e-0307fb40cbc3 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:00.518059 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-3cb0ade7-4ffe-4b9d-a48e-0307fb40cbc3 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:00.527315 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3cb0ade7-4ffe-4b9d-a48e-0307fb40cbc3 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:00.528322 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3cb0ade7-4ffe-4b9d-a48e-0307fb40cbc3 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:00.529182 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3cb0ade7-4ffe-4b9d-a48e-0307fb40cbc3 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:00.529692 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3cb0ade7-4ffe-4b9d-a48e-0307fb40cbc3 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:00.613927 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f171bdbf-a24f-45b0-8f40-5fdf170d5a18 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:00.621466 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-f171bdbf-a24f-45b0-8f40-5fdf170d5a18 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5" status: 200 len: 1520 microversion: 2.1 time: 0.240076 Jun 03 09:59:00.630626 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 112/250] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:00 2022] GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5 => generated 1520 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:00.635687 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-3cb0ade7-4ffe-4b9d-a48e-0307fb40cbc3 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:00.644262 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-3cb0ade7-4ffe-4b9d-a48e-0307fb40cbc3 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1309 microversion: 2.1 time: 0.131531 Jun 03 09:59:00.644862 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 139/251] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:00 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1309 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:01.640980 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-f5abb90a-938f-45f2-aeac-8c2aed4fc2f8 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:01.642562 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-f5abb90a-938f-45f2-aeac-8c2aed4fc2f8 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 59f3fa08-01f7-45d5-ae2b-171882dbc9c5] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:01.650471 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f5abb90a-938f-45f2-aeac-8c2aed4fc2f8 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:01.651194 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f5abb90a-938f-45f2-aeac-8c2aed4fc2f8 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:01.652365 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f5abb90a-938f-45f2-aeac-8c2aed4fc2f8 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:01.653055 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f5abb90a-938f-45f2-aeac-8c2aed4fc2f8 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:01.663774 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-e6dfb0b2-9515-43b2-8f95-7c20bc2ad592 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:01.665380 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-e6dfb0b2-9515-43b2-8f95-7c20bc2ad592 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:01.677999 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e6dfb0b2-9515-43b2-8f95-7c20bc2ad592 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:01.679328 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e6dfb0b2-9515-43b2-8f95-7c20bc2ad592 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:01.681090 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e6dfb0b2-9515-43b2-8f95-7c20bc2ad592 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:01.682075 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e6dfb0b2-9515-43b2-8f95-7c20bc2ad592 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:01.777541 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-e6dfb0b2-9515-43b2-8f95-7c20bc2ad592 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:01.787563 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-e6dfb0b2-9515-43b2-8f95-7c20bc2ad592 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1315 microversion: 2.1 time: 0.128956 Jun 03 09:59:01.788700 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 140/252] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:01 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1315 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:01.862377 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f5abb90a-938f-45f2-aeac-8c2aed4fc2f8 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:01.878187 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-f5abb90a-938f-45f2-aeac-8c2aed4fc2f8 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5" status: 200 len: 1520 microversion: 2.1 time: 0.241866 Jun 03 09:59:01.879038 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 113/253] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:01 2022] GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5 => generated 1520 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:02.805815 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-6e4731bd-a532-4ee6-b38b-c2a6244f1ff0 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:02.807060 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-6e4731bd-a532-4ee6-b38b-c2a6244f1ff0 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:02.814974 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6e4731bd-a532-4ee6-b38b-c2a6244f1ff0 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:02.815538 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6e4731bd-a532-4ee6-b38b-c2a6244f1ff0 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:02.816466 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6e4731bd-a532-4ee6-b38b-c2a6244f1ff0 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:02.816936 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6e4731bd-a532-4ee6-b38b-c2a6244f1ff0 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:02.895134 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-e3254523-9a42-4147-aaaf-d2f974cb3468 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:02.895790 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-e3254523-9a42-4147-aaaf-d2f974cb3468 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 59f3fa08-01f7-45d5-ae2b-171882dbc9c5] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:02.903425 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e3254523-9a42-4147-aaaf-d2f974cb3468 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:02.903865 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e3254523-9a42-4147-aaaf-d2f974cb3468 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:02.904715 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e3254523-9a42-4147-aaaf-d2f974cb3468 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:02.905196 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e3254523-9a42-4147-aaaf-d2f974cb3468 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:03.003771 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-6e4731bd-a532-4ee6-b38b-c2a6244f1ff0 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:03.013170 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-6e4731bd-a532-4ee6-b38b-c2a6244f1ff0 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1357 microversion: 2.1 time: 0.211426 Jun 03 09:59:03.013845 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 141/254] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:02 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1357 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:03.082619 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-e3254523-9a42-4147-aaaf-d2f974cb3468 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:03.090177 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-e3254523-9a42-4147-aaaf-d2f974cb3468 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5" status: 200 len: 1520 microversion: 2.1 time: 0.199405 Jun 03 09:59:03.090750 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 114/255] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:02 2022] GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5 => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:59:04.033616 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-450a8800-ab15-4d5b-869c-588b4fcc14c9 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:04.035105 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-450a8800-ab15-4d5b-869c-588b4fcc14c9 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:04.045174 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-450a8800-ab15-4d5b-869c-588b4fcc14c9 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:04.047650 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-450a8800-ab15-4d5b-869c-588b4fcc14c9 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:04.049166 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-450a8800-ab15-4d5b-869c-588b4fcc14c9 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:04.049691 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-450a8800-ab15-4d5b-869c-588b4fcc14c9 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:04.110907 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-cc6f9886-9738-45f6-a27e-28f9a8397170 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:04.113158 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-cc6f9886-9738-45f6-a27e-28f9a8397170 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 59f3fa08-01f7-45d5-ae2b-171882dbc9c5] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:04.135258 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cc6f9886-9738-45f6-a27e-28f9a8397170 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:04.152193 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cc6f9886-9738-45f6-a27e-28f9a8397170 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:04.161484 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cc6f9886-9738-45f6-a27e-28f9a8397170 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:04.162841 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cc6f9886-9738-45f6-a27e-28f9a8397170 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:04.367605 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-450a8800-ab15-4d5b-869c-588b4fcc14c9 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:04.376331 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-450a8800-ab15-4d5b-869c-588b4fcc14c9 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1357 microversion: 2.1 time: 0.347078 Jun 03 09:59:04.377169 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 142/256] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:04 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1357 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:04.426629 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-cc6f9886-9738-45f6-a27e-28f9a8397170 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:04.436117 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-cc6f9886-9738-45f6-a27e-28f9a8397170 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5" status: 200 len: 1520 microversion: 2.1 time: 0.329148 Jun 03 09:59:04.437730 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 115/257] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:04 2022] GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5 => generated 1520 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:59:05.394843 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-a3551220-6bf2-4c71-910b-4411120a70ea tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:05.395557 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-a3551220-6bf2-4c71-910b-4411120a70ea tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:05.402206 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a3551220-6bf2-4c71-910b-4411120a70ea tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:05.402661 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a3551220-6bf2-4c71-910b-4411120a70ea tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:05.403435 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a3551220-6bf2-4c71-910b-4411120a70ea tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:05.403870 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a3551220-6bf2-4c71-910b-4411120a70ea tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:05.459158 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-c3ed4845-ce69-4037-96f2-6181e6225908 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:05.459774 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-c3ed4845-ce69-4037-96f2-6181e6225908 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 59f3fa08-01f7-45d5-ae2b-171882dbc9c5] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:05.476096 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c3ed4845-ce69-4037-96f2-6181e6225908 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:05.476552 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c3ed4845-ce69-4037-96f2-6181e6225908 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:05.479419 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c3ed4845-ce69-4037-96f2-6181e6225908 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:05.479874 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c3ed4845-ce69-4037-96f2-6181e6225908 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:05.591152 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-a3551220-6bf2-4c71-910b-4411120a70ea tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:05.600546 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-a3551220-6bf2-4c71-910b-4411120a70ea tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1357 microversion: 2.1 time: 0.210759 Jun 03 09:59:05.610605 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 143/258] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:05 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1357 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:05.667233 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-c3ed4845-ce69-4037-96f2-6181e6225908 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:05.675516 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-c3ed4845-ce69-4037-96f2-6181e6225908 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5" status: 200 len: 1520 microversion: 2.1 time: 0.225409 Jun 03 09:59:05.681460 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 116/259] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:05 2022] GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5 => generated 1520 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:06.617827 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-bac9f1b8-89a7-42a1-a91e-b411a9df3e43 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:06.618454 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-bac9f1b8-89a7-42a1-a91e-b411a9df3e43 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:06.646005 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bac9f1b8-89a7-42a1-a91e-b411a9df3e43 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:06.646746 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bac9f1b8-89a7-42a1-a91e-b411a9df3e43 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:06.647709 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bac9f1b8-89a7-42a1-a91e-b411a9df3e43 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:06.648432 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bac9f1b8-89a7-42a1-a91e-b411a9df3e43 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:06.656582 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=69 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:59:06.698478 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-9118d973-bcc5-44f3-8e7a-f3680ae4ec5c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:06.699786 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-9118d973-bcc5-44f3-8e7a-f3680ae4ec5c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 59f3fa08-01f7-45d5-ae2b-171882dbc9c5] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:06.710969 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9118d973-bcc5-44f3-8e7a-f3680ae4ec5c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:06.715335 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9118d973-bcc5-44f3-8e7a-f3680ae4ec5c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:06.723474 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9118d973-bcc5-44f3-8e7a-f3680ae4ec5c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:06.724191 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9118d973-bcc5-44f3-8e7a-f3680ae4ec5c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:06.963285 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-bac9f1b8-89a7-42a1-a91e-b411a9df3e43 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:06.978039 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-bac9f1b8-89a7-42a1-a91e-b411a9df3e43 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1357 microversion: 2.1 time: 0.358824 Jun 03 09:59:06.978039 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 144/260] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:06 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1357 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:07.013521 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-9118d973-bcc5-44f3-8e7a-f3680ae4ec5c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:07.021380 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-9118d973-bcc5-44f3-8e7a-f3680ae4ec5c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5" status: 200 len: 1520 microversion: 2.1 time: 0.326584 Jun 03 09:59:07.021980 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 117/261] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:06 2022] GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5 => generated 1520 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:59:07.991002 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-18a04ad5-0787-4045-b057-0f957de7e287 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:07.991617 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-18a04ad5-0787-4045-b057-0f957de7e287 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:07.998906 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-18a04ad5-0787-4045-b057-0f957de7e287 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:07.999631 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-18a04ad5-0787-4045-b057-0f957de7e287 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:08.000974 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-18a04ad5-0787-4045-b057-0f957de7e287 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:08.001412 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-18a04ad5-0787-4045-b057-0f957de7e287 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:08.038691 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-ecc439c0-4fba-455a-892b-b6d4ae2c5ddf tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:08.039944 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-ecc439c0-4fba-455a-892b-b6d4ae2c5ddf tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 59f3fa08-01f7-45d5-ae2b-171882dbc9c5] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:08.047737 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ecc439c0-4fba-455a-892b-b6d4ae2c5ddf tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:08.048230 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ecc439c0-4fba-455a-892b-b6d4ae2c5ddf tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:08.049016 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ecc439c0-4fba-455a-892b-b6d4ae2c5ddf tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:08.049459 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ecc439c0-4fba-455a-892b-b6d4ae2c5ddf tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:08.232188 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-18a04ad5-0787-4045-b057-0f957de7e287 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:08.245618 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-18a04ad5-0787-4045-b057-0f957de7e287 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1357 microversion: 2.1 time: 0.258263 Jun 03 09:59:08.249903 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 145/262] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:07 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1357 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:08.269546 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-ecc439c0-4fba-455a-892b-b6d4ae2c5ddf tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:08.277469 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-ecc439c0-4fba-455a-892b-b6d4ae2c5ddf tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5" status: 200 len: 1520 microversion: 2.1 time: 0.242498 Jun 03 09:59:08.278073 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 118/263] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:08 2022] GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5 => generated 1520 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:59:09.266780 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-316be715-0370-46c8-86af-9064594c0ae3 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:09.268333 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-316be715-0370-46c8-86af-9064594c0ae3 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:09.275069 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-316be715-0370-46c8-86af-9064594c0ae3 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:09.275856 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-316be715-0370-46c8-86af-9064594c0ae3 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:09.276855 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-316be715-0370-46c8-86af-9064594c0ae3 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:09.277387 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-316be715-0370-46c8-86af-9064594c0ae3 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:09.295085 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-a7bc297b-4f70-4947-829d-d612ed5aa532 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:09.296343 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-a7bc297b-4f70-4947-829d-d612ed5aa532 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 59f3fa08-01f7-45d5-ae2b-171882dbc9c5] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:09.303161 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a7bc297b-4f70-4947-829d-d612ed5aa532 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:09.303606 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a7bc297b-4f70-4947-829d-d612ed5aa532 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:09.304573 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a7bc297b-4f70-4947-829d-d612ed5aa532 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:09.305169 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a7bc297b-4f70-4947-829d-d612ed5aa532 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:09.346863 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell0:SELECT=2 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:59:09.368141 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell0:SELECT=6 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:59:09.483341 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-316be715-0370-46c8-86af-9064594c0ae3 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:09.492388 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-316be715-0370-46c8-86af-9064594c0ae3 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1357 microversion: 2.1 time: 0.229703 Jun 03 09:59:09.494138 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 146/264] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:09 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1357 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:09.496949 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-a7bc297b-4f70-4947-829d-d612ed5aa532 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:09.506473 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-a7bc297b-4f70-4947-829d-d612ed5aa532 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5" status: 200 len: 1520 microversion: 2.1 time: 0.215091 Jun 03 09:59:09.507844 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 119/265] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:09 2022] GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5 => generated 1520 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:59:10.509803 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-37a04e40-1e4e-465f-becf-be9894388d38 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:10.510518 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-37a04e40-1e4e-465f-becf-be9894388d38 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:10.512492 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell0:SELECT=10 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:59:10.521774 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-37a04e40-1e4e-465f-becf-be9894388d38 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:10.521774 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-37a04e40-1e4e-465f-becf-be9894388d38 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:10.523570 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-37a04e40-1e4e-465f-becf-be9894388d38 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:10.524404 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-37a04e40-1e4e-465f-becf-be9894388d38 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:10.531017 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-0851e1ea-0ddc-4ecb-960f-4f9250c39266 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:10.531632 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-0851e1ea-0ddc-4ecb-960f-4f9250c39266 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 59f3fa08-01f7-45d5-ae2b-171882dbc9c5] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:10.539469 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0851e1ea-0ddc-4ecb-960f-4f9250c39266 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:10.539957 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0851e1ea-0ddc-4ecb-960f-4f9250c39266 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:10.540740 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0851e1ea-0ddc-4ecb-960f-4f9250c39266 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:10.541215 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0851e1ea-0ddc-4ecb-960f-4f9250c39266 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:10.737856 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-37a04e40-1e4e-465f-becf-be9894388d38 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:10.745264 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-37a04e40-1e4e-465f-becf-be9894388d38 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1357 microversion: 2.1 time: 0.239516 Jun 03 09:59:10.745857 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 147/266] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:10 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1357 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:10.753591 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-0851e1ea-0ddc-4ecb-960f-4f9250c39266 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:10.762189 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-0851e1ea-0ddc-4ecb-960f-4f9250c39266 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5" status: 200 len: 1520 microversion: 2.1 time: 0.235995 Jun 03 09:59:10.772532 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 120/267] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:10 2022] GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5 => generated 1520 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:11.762763 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-1598655c-f031-4a26-b8a7-40aa1746f5ec tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:11.763391 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-1598655c-f031-4a26-b8a7-40aa1746f5ec tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:11.770157 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1598655c-f031-4a26-b8a7-40aa1746f5ec tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:11.770617 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1598655c-f031-4a26-b8a7-40aa1746f5ec tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:11.771400 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1598655c-f031-4a26-b8a7-40aa1746f5ec tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:11.771844 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1598655c-f031-4a26-b8a7-40aa1746f5ec tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:11.784390 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-659cf0dc-5948-4b23-b04a-8070c6c1f192 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:11.786481 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-659cf0dc-5948-4b23-b04a-8070c6c1f192 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 59f3fa08-01f7-45d5-ae2b-171882dbc9c5] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:11.793448 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-659cf0dc-5948-4b23-b04a-8070c6c1f192 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:11.793930 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-659cf0dc-5948-4b23-b04a-8070c6c1f192 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:11.794699 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-659cf0dc-5948-4b23-b04a-8070c6c1f192 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:11.795169 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-659cf0dc-5948-4b23-b04a-8070c6c1f192 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:11.990865 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-1598655c-f031-4a26-b8a7-40aa1746f5ec tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:11.998957 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-1598655c-f031-4a26-b8a7-40aa1746f5ec tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1357 microversion: 2.1 time: 0.239968 Jun 03 09:59:12.000042 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 148/268] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:11 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1357 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:12.020530 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-659cf0dc-5948-4b23-b04a-8070c6c1f192 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:12.028334 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-659cf0dc-5948-4b23-b04a-8070c6c1f192 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5" status: 200 len: 1520 microversion: 2.1 time: 0.252181 Jun 03 09:59:12.028923 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 121/269] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:11 2022] GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5 => generated 1520 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:13.016608 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-01bb3d43-0d1a-4618-a930-5b8cb409791a tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:13.017253 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-01bb3d43-0d1a-4618-a930-5b8cb409791a tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:13.019155 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=2 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:59:13.024941 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-01bb3d43-0d1a-4618-a930-5b8cb409791a tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:13.025393 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-01bb3d43-0d1a-4618-a930-5b8cb409791a tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:13.026196 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-01bb3d43-0d1a-4618-a930-5b8cb409791a tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:13.026631 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-01bb3d43-0d1a-4618-a930-5b8cb409791a tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:13.047643 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-cc0f11a6-77ad-4906-80ed-f9619d5131a7 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:13.048913 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-cc0f11a6-77ad-4906-80ed-f9619d5131a7 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 59f3fa08-01f7-45d5-ae2b-171882dbc9c5] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:13.056119 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cc0f11a6-77ad-4906-80ed-f9619d5131a7 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:13.057119 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cc0f11a6-77ad-4906-80ed-f9619d5131a7 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:13.058229 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cc0f11a6-77ad-4906-80ed-f9619d5131a7 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:13.058961 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cc0f11a6-77ad-4906-80ed-f9619d5131a7 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:13.076206 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell1:SELECT=100 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:59:13.431550 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-cc0f11a6-77ad-4906-80ed-f9619d5131a7 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:13.439129 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-cc0f11a6-77ad-4906-80ed-f9619d5131a7 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5" status: 200 len: 1520 microversion: 2.1 time: 0.396247 Jun 03 09:59:13.439782 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 122/270] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:13 2022] GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5 => generated 1520 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:13.445724 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-01bb3d43-0d1a-4618-a930-5b8cb409791a tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:13.453376 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-01bb3d43-0d1a-4618-a930-5b8cb409791a tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1357 microversion: 2.1 time: 0.440851 Jun 03 09:59:13.453981 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 149/271] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:13 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1357 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:14.457453 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-66de1a93-c196-4a7b-80e9-ce85e55f1c44 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:14.458093 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-66de1a93-c196-4a7b-80e9-ce85e55f1c44 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 59f3fa08-01f7-45d5-ae2b-171882dbc9c5] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:14.464232 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-66de1a93-c196-4a7b-80e9-ce85e55f1c44 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:14.468322 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-66de1a93-c196-4a7b-80e9-ce85e55f1c44 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:14.469132 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-66de1a93-c196-4a7b-80e9-ce85e55f1c44 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:14.469576 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-66de1a93-c196-4a7b-80e9-ce85e55f1c44 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:14.471152 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-796e1229-9b93-4676-a0e8-13104a6ecbb9 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:14.471773 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-796e1229-9b93-4676-a0e8-13104a6ecbb9 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:14.478242 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-796e1229-9b93-4676-a0e8-13104a6ecbb9 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:14.478884 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-796e1229-9b93-4676-a0e8-13104a6ecbb9 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:14.479817 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-796e1229-9b93-4676-a0e8-13104a6ecbb9 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:14.480534 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-796e1229-9b93-4676-a0e8-13104a6ecbb9 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:14.697082 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-66de1a93-c196-4a7b-80e9-ce85e55f1c44 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:14.701340 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-796e1229-9b93-4676-a0e8-13104a6ecbb9 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:14.705193 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-66de1a93-c196-4a7b-80e9-ce85e55f1c44 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5" status: 200 len: 1520 microversion: 2.1 time: 0.252502 Jun 03 09:59:14.706182 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 123/272] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:14 2022] GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5 => generated 1520 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:14.709192 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-796e1229-9b93-4676-a0e8-13104a6ecbb9 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1357 microversion: 2.1 time: 0.243345 Jun 03 09:59:14.712257 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 150/273] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:14 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1357 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:15.725016 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-c929add6-565e-453f-80de-92e15dfa134a tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:15.725632 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-c929add6-565e-453f-80de-92e15dfa134a tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 59f3fa08-01f7-45d5-ae2b-171882dbc9c5] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:15.730597 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-5ad521b9-6b4d-494a-9bff-6d6ea21fdb56 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:15.731209 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-5ad521b9-6b4d-494a-9bff-6d6ea21fdb56 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:15.737579 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c929add6-565e-453f-80de-92e15dfa134a tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:15.738120 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5ad521b9-6b4d-494a-9bff-6d6ea21fdb56 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:15.738269 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c929add6-565e-453f-80de-92e15dfa134a tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:15.739007 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c929add6-565e-453f-80de-92e15dfa134a tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:15.739593 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c929add6-565e-453f-80de-92e15dfa134a tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:15.739844 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5ad521b9-6b4d-494a-9bff-6d6ea21fdb56 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:15.740792 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5ad521b9-6b4d-494a-9bff-6d6ea21fdb56 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:15.741391 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5ad521b9-6b4d-494a-9bff-6d6ea21fdb56 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:15.974894 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-5ad521b9-6b4d-494a-9bff-6d6ea21fdb56 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:15.984304 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-5ad521b9-6b4d-494a-9bff-6d6ea21fdb56 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1357 microversion: 2.1 time: 0.257306 Jun 03 09:59:15.984991 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 151/274] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:15 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1357 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:15.990182 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-e5987cd9-b686-43eb-80da-64774dc2ceba req-64fdb598-2eaa-42cc-a7ca-94de0fd5c34b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef716191-e303-4e00-a92c-78d4fb06063f", "tag": "1567f4c3-0049-47d8-914a-22f5172d29dc"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:59:15.999085 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-e5987cd9-b686-43eb-80da-64774dc2ceba req-64fdb598-2eaa-42cc-a7ca-94de0fd5c34b service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:15.999818 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-e5987cd9-b686-43eb-80da-64774dc2ceba req-64fdb598-2eaa-42cc-a7ca-94de0fd5c34b service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:16.006081 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-c929add6-565e-453f-80de-92e15dfa134a tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:16.014560 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-c929add6-565e-453f-80de-92e15dfa134a tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5" status: 200 len: 1520 microversion: 2.1 time: 0.293861 Jun 03 09:59:16.015986 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 124/275] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:15 2022] GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5 => generated 1520 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:16.023044 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-e5987cd9-b686-43eb-80da-64774dc2ceba req-64fdb598-2eaa-42cc-a7ca-94de0fd5c34b service nova] Creating event network-changed:1567f4c3-0049-47d8-914a-22f5172d29dc for instance ef716191-e303-4e00-a92c-78d4fb06063f on hv-cinder-79760 Jun 03 09:59:16.035178 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-e5987cd9-b686-43eb-80da-64774dc2ceba req-64fdb598-2eaa-42cc-a7ca-94de0fd5c34b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048556 Jun 03 09:59:16.035785 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 152/276] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 09:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:59:17.001691 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-29c5ebef-551b-4313-88a7-352d12e6981e tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:17.002481 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-29c5ebef-551b-4313-88a7-352d12e6981e tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:17.009308 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-29c5ebef-551b-4313-88a7-352d12e6981e tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:17.009784 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-29c5ebef-551b-4313-88a7-352d12e6981e tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:17.010566 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-29c5ebef-551b-4313-88a7-352d12e6981e tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:17.011007 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-29c5ebef-551b-4313-88a7-352d12e6981e tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:17.032534 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-36377d13-7c76-40e8-93e8-69ec47170b93 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:17.033232 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-36377d13-7c76-40e8-93e8-69ec47170b93 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 59f3fa08-01f7-45d5-ae2b-171882dbc9c5] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:17.039828 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-36377d13-7c76-40e8-93e8-69ec47170b93 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:17.040515 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-36377d13-7c76-40e8-93e8-69ec47170b93 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:17.041300 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-36377d13-7c76-40e8-93e8-69ec47170b93 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:17.041738 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-36377d13-7c76-40e8-93e8-69ec47170b93 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:17.223874 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-29c5ebef-551b-4313-88a7-352d12e6981e tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:17.231788 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-29c5ebef-551b-4313-88a7-352d12e6981e tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1357 microversion: 2.1 time: 0.234349 Jun 03 09:59:17.232735 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 125/277] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:16 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1357 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:17.244525 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-36377d13-7c76-40e8-93e8-69ec47170b93 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:17.252855 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-36377d13-7c76-40e8-93e8-69ec47170b93 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5" status: 200 len: 1520 microversion: 2.1 time: 0.224735 Jun 03 09:59:17.253415 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 153/278] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:17 2022] GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5 => generated 1520 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:18.250618 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-944c6eb9-0c3f-40f2-be6b-afda31400d6c tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:18.251228 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-944c6eb9-0c3f-40f2-be6b-afda31400d6c tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:18.258004 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-944c6eb9-0c3f-40f2-be6b-afda31400d6c tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:18.258457 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-944c6eb9-0c3f-40f2-be6b-afda31400d6c tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:18.259221 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-944c6eb9-0c3f-40f2-be6b-afda31400d6c tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:18.259657 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-944c6eb9-0c3f-40f2-be6b-afda31400d6c tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:18.270331 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-d932fd9a-f984-457c-8787-e474835902b4 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:18.270985 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-d932fd9a-f984-457c-8787-e474835902b4 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 59f3fa08-01f7-45d5-ae2b-171882dbc9c5] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:18.277410 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d932fd9a-f984-457c-8787-e474835902b4 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:18.278180 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d932fd9a-f984-457c-8787-e474835902b4 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:18.278973 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d932fd9a-f984-457c-8787-e474835902b4 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:18.279413 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d932fd9a-f984-457c-8787-e474835902b4 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:18.465974 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-944c6eb9-0c3f-40f2-be6b-afda31400d6c tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:18.470476 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-d932fd9a-f984-457c-8787-e474835902b4 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:18.475822 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-944c6eb9-0c3f-40f2-be6b-afda31400d6c tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1357 microversion: 2.1 time: 0.229318 Jun 03 09:59:18.476504 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 126/279] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:18 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1357 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:18.478298 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-d932fd9a-f984-457c-8787-e474835902b4 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5" status: 200 len: 1520 microversion: 2.1 time: 0.212209 Jun 03 09:59:18.478943 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 154/280] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:18 2022] GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5 => generated 1520 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:59:19.493362 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-46f875b6-6713-4f89-b1d5-c81bae799d49 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:19.494082 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-46f875b6-6713-4f89-b1d5-c81bae799d49 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:19.494773 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-6d2e408f-e8f1-4743-9ea8-0a3d64653c5c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:19.495413 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-6d2e408f-e8f1-4743-9ea8-0a3d64653c5c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 59f3fa08-01f7-45d5-ae2b-171882dbc9c5] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:19.502398 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6d2e408f-e8f1-4743-9ea8-0a3d64653c5c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:19.502867 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6d2e408f-e8f1-4743-9ea8-0a3d64653c5c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:19.503663 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6d2e408f-e8f1-4743-9ea8-0a3d64653c5c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:19.504106 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6d2e408f-e8f1-4743-9ea8-0a3d64653c5c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:19.506579 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-46f875b6-6713-4f89-b1d5-c81bae799d49 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:19.507060 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-46f875b6-6713-4f89-b1d5-c81bae799d49 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:19.508097 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-46f875b6-6713-4f89-b1d5-c81bae799d49 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:19.512742 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-46f875b6-6713-4f89-b1d5-c81bae799d49 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:19.703518 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-6d2e408f-e8f1-4743-9ea8-0a3d64653c5c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:19.711006 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-6d2e408f-e8f1-4743-9ea8-0a3d64653c5c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5" status: 200 len: 1520 microversion: 2.1 time: 0.220039 Jun 03 09:59:19.711600 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 155/281] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:19 2022] GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5 => generated 1520 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:59:19.720568 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-46f875b6-6713-4f89-b1d5-c81bae799d49 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:19.727597 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-46f875b6-6713-4f89-b1d5-c81bae799d49 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1357 microversion: 2.1 time: 0.238344 Jun 03 09:59:19.728161 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 127/282] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:19 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1357 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:20.728128 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-e9ab502d-52a4-47d9-8ead-537ae06b529b tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:20.728734 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-e9ab502d-52a4-47d9-8ead-537ae06b529b tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 59f3fa08-01f7-45d5-ae2b-171882dbc9c5] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:20.735179 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e9ab502d-52a4-47d9-8ead-537ae06b529b tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:20.735620 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e9ab502d-52a4-47d9-8ead-537ae06b529b tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:20.736369 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e9ab502d-52a4-47d9-8ead-537ae06b529b tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:20.736795 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e9ab502d-52a4-47d9-8ead-537ae06b529b tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:20.744611 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-ce5775eb-e829-4908-a03f-c972a5e1905e tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:20.745228 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-ce5775eb-e829-4908-a03f-c972a5e1905e tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:20.751716 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ce5775eb-e829-4908-a03f-c972a5e1905e tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:20.752170 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ce5775eb-e829-4908-a03f-c972a5e1905e tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:20.752934 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ce5775eb-e829-4908-a03f-c972a5e1905e tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:20.753688 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ce5775eb-e829-4908-a03f-c972a5e1905e tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:20.954310 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-e9ab502d-52a4-47d9-8ead-537ae06b529b tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:20.972457 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-ce5775eb-e829-4908-a03f-c972a5e1905e tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:20.973011 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-e9ab502d-52a4-47d9-8ead-537ae06b529b tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5" status: 200 len: 1520 microversion: 2.1 time: 0.248591 Jun 03 09:59:20.973549 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 156/283] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:20 2022] GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5 => generated 1520 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:20.980857 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-ce5775eb-e829-4908-a03f-c972a5e1905e tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1357 microversion: 2.1 time: 0.240314 Jun 03 09:59:20.982020 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 128/284] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:20 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1357 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:59:21.998063 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-0e67c30f-a8b9-4feb-b268-00599c9e00be tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:21.998468 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-d8dee71f-899d-40a6-aa57-769486937cef tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:21.998808 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-d8dee71f-899d-40a6-aa57-769486937cef tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 59f3fa08-01f7-45d5-ae2b-171882dbc9c5] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:21.998885 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-0e67c30f-a8b9-4feb-b268-00599c9e00be tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:22.005517 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0e67c30f-a8b9-4feb-b268-00599c9e00be tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:22.006091 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0e67c30f-a8b9-4feb-b268-00599c9e00be tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:22.006310 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d8dee71f-899d-40a6-aa57-769486937cef tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:22.006749 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d8dee71f-899d-40a6-aa57-769486937cef tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:22.006893 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0e67c30f-a8b9-4feb-b268-00599c9e00be tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:22.007182 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0e67c30f-a8b9-4feb-b268-00599c9e00be tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:22.011628 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d8dee71f-899d-40a6-aa57-769486937cef tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:22.012270 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d8dee71f-899d-40a6-aa57-769486937cef tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:22.212885 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-0e67c30f-a8b9-4feb-b268-00599c9e00be tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:22.222147 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-0e67c30f-a8b9-4feb-b268-00599c9e00be tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1357 microversion: 2.1 time: 0.227731 Jun 03 09:59:22.222911 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 157/285] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:21 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1357 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:22.235248 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d8dee71f-899d-40a6-aa57-769486937cef tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:22.243927 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-d8dee71f-899d-40a6-aa57-769486937cef tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5" status: 200 len: 1520 microversion: 2.1 time: 0.249372 Jun 03 09:59:22.244648 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 129/286] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:21 2022] GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5 => generated 1520 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:23.239727 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-87661c56-4f8a-400d-899d-e2178b34f461 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:23.240470 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-87661c56-4f8a-400d-899d-e2178b34f461 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:23.246742 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-87661c56-4f8a-400d-899d-e2178b34f461 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:23.247189 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-87661c56-4f8a-400d-899d-e2178b34f461 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:23.247996 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-87661c56-4f8a-400d-899d-e2178b34f461 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:23.248555 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-87661c56-4f8a-400d-899d-e2178b34f461 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:23.260487 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-ba10918e-ae5c-43a0-8cc4-c8b4064f629a tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:23.261316 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-ba10918e-ae5c-43a0-8cc4-c8b4064f629a tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 59f3fa08-01f7-45d5-ae2b-171882dbc9c5] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:23.268225 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:59:23.270442 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ba10918e-ae5c-43a0-8cc4-c8b4064f629a tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:23.278788 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ba10918e-ae5c-43a0-8cc4-c8b4064f629a tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:23.279733 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ba10918e-ae5c-43a0-8cc4-c8b4064f629a tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:23.280359 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ba10918e-ae5c-43a0-8cc4-c8b4064f629a tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:23.479429 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-87661c56-4f8a-400d-899d-e2178b34f461 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:23.490860 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-87661c56-4f8a-400d-899d-e2178b34f461 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1357 microversion: 2.1 time: 0.252549 Jun 03 09:59:23.491484 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 158/287] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:23 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1357 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:23.507499 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-ba10918e-ae5c-43a0-8cc4-c8b4064f629a tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:23.515613 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-ba10918e-ae5c-43a0-8cc4-c8b4064f629a tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5" status: 200 len: 1520 microversion: 2.1 time: 0.258454 Jun 03 09:59:23.516142 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 130/288] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:23 2022] GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5 => generated 1520 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:59:23.871066 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-c08db781-b052-44e5-b1d6-dda1cdd64a51 req-2a486f91-8796-4347-a810-ea4852f8476a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef716191-e303-4e00-a92c-78d4fb06063f", "name": "network-vif-plugged", "status": "completed", "tag": "1567f4c3-0049-47d8-914a-22f5172d29dc"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:59:23.883500 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-c08db781-b052-44e5-b1d6-dda1cdd64a51 req-2a486f91-8796-4347-a810-ea4852f8476a service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:23.884139 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-c08db781-b052-44e5-b1d6-dda1cdd64a51 req-2a486f91-8796-4347-a810-ea4852f8476a service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:23.899215 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-c08db781-b052-44e5-b1d6-dda1cdd64a51 req-2a486f91-8796-4347-a810-ea4852f8476a service nova] Creating event network-vif-plugged:1567f4c3-0049-47d8-914a-22f5172d29dc for instance ef716191-e303-4e00-a92c-78d4fb06063f on hv-cinder-79760 Jun 03 09:59:23.912050 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-c08db781-b052-44e5-b1d6-dda1cdd64a51 req-2a486f91-8796-4347-a810-ea4852f8476a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042652 Jun 03 09:59:23.912719 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 159/289] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 09:59:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 09:59:24.508954 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-c98d5736-4da6-4769-ad63-83ece95539cf tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:24.509578 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-c98d5736-4da6-4769-ad63-83ece95539cf tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:24.518303 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c98d5736-4da6-4769-ad63-83ece95539cf tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:24.519484 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c98d5736-4da6-4769-ad63-83ece95539cf tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:24.520764 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c98d5736-4da6-4769-ad63-83ece95539cf tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:24.521212 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c98d5736-4da6-4769-ad63-83ece95539cf tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:24.536064 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-94edc4b9-e82b-493c-81e0-4c9b33332d56 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:24.537433 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-94edc4b9-e82b-493c-81e0-4c9b33332d56 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 59f3fa08-01f7-45d5-ae2b-171882dbc9c5] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:24.544324 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-94edc4b9-e82b-493c-81e0-4c9b33332d56 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:24.545058 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-94edc4b9-e82b-493c-81e0-4c9b33332d56 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:24.546093 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-94edc4b9-e82b-493c-81e0-4c9b33332d56 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:24.546783 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-94edc4b9-e82b-493c-81e0-4c9b33332d56 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:24.735564 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-c98d5736-4da6-4769-ad63-83ece95539cf tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:24.746178 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-c98d5736-4da6-4769-ad63-83ece95539cf tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1357 microversion: 2.1 time: 0.242010 Jun 03 09:59:24.746770 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 131/290] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:24 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1357 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:24.752853 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-94edc4b9-e82b-493c-81e0-4c9b33332d56 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:24.760465 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-94edc4b9-e82b-493c-81e0-4c9b33332d56 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5" status: 200 len: 1520 microversion: 2.1 time: 0.229953 Jun 03 09:59:24.761022 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 160/291] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:24 2022] GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5 => generated 1520 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:25.763355 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-44364166-63ab-4d6f-b2ef-093ea9f20830 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:25.763995 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-44364166-63ab-4d6f-b2ef-093ea9f20830 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:25.770370 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-44364166-63ab-4d6f-b2ef-093ea9f20830 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:25.770812 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-44364166-63ab-4d6f-b2ef-093ea9f20830 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:25.771588 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-44364166-63ab-4d6f-b2ef-093ea9f20830 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:25.772021 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-44364166-63ab-4d6f-b2ef-093ea9f20830 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:25.777738 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-4e6b2b52-ae34-4a2c-a3f6-9365e296ab39 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:25.778384 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-4e6b2b52-ae34-4a2c-a3f6-9365e296ab39 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 59f3fa08-01f7-45d5-ae2b-171882dbc9c5] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:25.784590 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4e6b2b52-ae34-4a2c-a3f6-9365e296ab39 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:25.785034 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4e6b2b52-ae34-4a2c-a3f6-9365e296ab39 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:25.785818 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4e6b2b52-ae34-4a2c-a3f6-9365e296ab39 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:25.786262 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4e6b2b52-ae34-4a2c-a3f6-9365e296ab39 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:25.982429 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-44364166-63ab-4d6f-b2ef-093ea9f20830 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:25.987388 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-4e6b2b52-ae34-4a2c-a3f6-9365e296ab39 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:25.991495 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-44364166-63ab-4d6f-b2ef-093ea9f20830 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1357 microversion: 2.1 time: 0.231920 Jun 03 09:59:25.992073 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 132/292] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:25 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1357 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:26.001557 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-4e6b2b52-ae34-4a2c-a3f6-9365e296ab39 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5" status: 200 len: 1520 microversion: 2.1 time: 0.227516 Jun 03 09:59:26.002162 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 161/293] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:25 2022] GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5 => generated 1520 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:59:27.011334 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-5b1c94ee-2e83-4aa5-b219-0b6d2ba0c9b8 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:27.012601 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-5b1c94ee-2e83-4aa5-b219-0b6d2ba0c9b8 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:27.020240 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-169af684-87de-4da2-8a4f-b4b85ea0adb4 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:27.020964 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-169af684-87de-4da2-8a4f-b4b85ea0adb4 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 59f3fa08-01f7-45d5-ae2b-171882dbc9c5] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:27.021505 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5b1c94ee-2e83-4aa5-b219-0b6d2ba0c9b8 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:27.022081 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5b1c94ee-2e83-4aa5-b219-0b6d2ba0c9b8 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:27.023445 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5b1c94ee-2e83-4aa5-b219-0b6d2ba0c9b8 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:27.024687 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5b1c94ee-2e83-4aa5-b219-0b6d2ba0c9b8 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:27.028855 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-169af684-87de-4da2-8a4f-b4b85ea0adb4 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:27.029408 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-169af684-87de-4da2-8a4f-b4b85ea0adb4 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:27.030703 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-169af684-87de-4da2-8a4f-b4b85ea0adb4 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:27.031373 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-169af684-87de-4da2-8a4f-b4b85ea0adb4 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:27.036159 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=100 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:59:27.230125 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-5b1c94ee-2e83-4aa5-b219-0b6d2ba0c9b8 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:27.237174 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-169af684-87de-4da2-8a4f-b4b85ea0adb4 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:27.240663 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-5b1c94ee-2e83-4aa5-b219-0b6d2ba0c9b8 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1545 microversion: 2.1 time: 0.234125 Jun 03 09:59:27.241829 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 133/294] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:27 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1545 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:27.257579 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-169af684-87de-4da2-8a4f-b4b85ea0adb4 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5" status: 200 len: 1520 microversion: 2.1 time: 0.242042 Jun 03 09:59:27.257790 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-0b81a4ed-b47f-41e9-8518-421f1de38f78 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:27.258399 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-0b81a4ed-b47f-41e9-8518-421f1de38f78 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:27.259243 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 162/295] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:27 2022] GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5 => generated 1520 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:59:27.264553 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0b81a4ed-b47f-41e9-8518-421f1de38f78 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:27.265540 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0b81a4ed-b47f-41e9-8518-421f1de38f78 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:27.266343 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0b81a4ed-b47f-41e9-8518-421f1de38f78 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:27.266957 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0b81a4ed-b47f-41e9-8518-421f1de38f78 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:27.467679 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-0b81a4ed-b47f-41e9-8518-421f1de38f78 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:27.476237 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-0b81a4ed-b47f-41e9-8518-421f1de38f78 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1545 microversion: 2.1 time: 0.222322 Jun 03 09:59:27.477113 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 134/296] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:27 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1545 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:59:27.492525 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-44b11791-6c8c-4e6a-b33d-8964e2e02196 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:27.496019 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-44b11791-6c8c-4e6a-b33d-8964e2e02196 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:27.496873 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-44b11791-6c8c-4e6a-b33d-8964e2e02196 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Searching by: {'deleted': False, 'project_id': 'd3c4a1843a98436c81df8111244795ac'} {{(pid=117647) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 03 09:59:27.504469 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-44b11791-6c8c-4e6a-b33d-8964e2e02196 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:27.504469 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-44b11791-6c8c-4e6a-b33d-8964e2e02196 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:27.505201 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-44b11791-6c8c-4e6a-b33d-8964e2e02196 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:27.505873 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-44b11791-6c8c-4e6a-b33d-8964e2e02196 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:27.601440 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.multi_cell_list [None req-44b11791-6c8c-4e6a-b33d-8964e2e02196 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117647) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 03 09:59:27.707429 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-44b11791-6c8c-4e6a-b33d-8964e2e02196 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.218573 Jun 03 09:59:27.708224 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 163/297] 10.222.0.45 () {58 vars in 1124 bytes} [Fri Jun 3 09:59:27 2022] GET /compute/v2.1/servers => generated 342 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 09:59:27.718656 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-23562c97-0606-4280-bc36-e535cde1b66c tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:27.719262 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-23562c97-0606-4280-bc36-e535cde1b66c tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:27.725519 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-23562c97-0606-4280-bc36-e535cde1b66c tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:27.726021 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-23562c97-0606-4280-bc36-e535cde1b66c tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:27.726792 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-23562c97-0606-4280-bc36-e535cde1b66c tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:27.727224 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-23562c97-0606-4280-bc36-e535cde1b66c tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:27.869483 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-23562c97-0606-4280-bc36-e535cde1b66c tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:27.877565 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-23562c97-0606-4280-bc36-e535cde1b66c tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1545 microversion: 2.1 time: 0.162791 Jun 03 09:59:27.878161 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 135/298] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:27 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1545 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:59:28.276335 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-11a33c08-b287-485e-90f1-1c8e041099a1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:28.277058 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-11a33c08-b287-485e-90f1-1c8e041099a1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 59f3fa08-01f7-45d5-ae2b-171882dbc9c5] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:28.283370 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-11a33c08-b287-485e-90f1-1c8e041099a1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:28.283823 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-11a33c08-b287-485e-90f1-1c8e041099a1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:28.284584 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-11a33c08-b287-485e-90f1-1c8e041099a1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:28.285025 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-11a33c08-b287-485e-90f1-1c8e041099a1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:28.415029 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-11a33c08-b287-485e-90f1-1c8e041099a1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:28.423014 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-11a33c08-b287-485e-90f1-1c8e041099a1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5" status: 200 len: 1520 microversion: 2.1 time: 0.150575 Jun 03 09:59:28.423575 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 164/299] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:28 2022] GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:29.406554 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-f78a2d23-e652-47f0-93a3-f4d357ab2adc tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e7fa8335-7b82-43c0-86ea-c6d74fdcdefc"}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:59:29.407932 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-f78a2d23-e652-47f0-93a3-f4d357ab2adc tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:29.414299 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f78a2d23-e652-47f0-93a3-f4d357ab2adc tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:29.414743 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f78a2d23-e652-47f0-93a3-f4d357ab2adc tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:29.415494 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f78a2d23-e652-47f0-93a3-f4d357ab2adc tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:29.415923 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f78a2d23-e652-47f0-93a3-f4d357ab2adc tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:29.439538 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-78984a87-50b1-4b6d-950e-dff582ffeb50 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:29.440152 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-78984a87-50b1-4b6d-950e-dff582ffeb50 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 59f3fa08-01f7-45d5-ae2b-171882dbc9c5] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:29.446200 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-78984a87-50b1-4b6d-950e-dff582ffeb50 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:29.446653 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-78984a87-50b1-4b6d-950e-dff582ffeb50 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:29.447424 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-78984a87-50b1-4b6d-950e-dff582ffeb50 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:29.447861 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-78984a87-50b1-4b6d-950e-dff582ffeb50 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:29.574681 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-78984a87-50b1-4b6d-950e-dff582ffeb50 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:29.582886 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-78984a87-50b1-4b6d-950e-dff582ffeb50 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5" status: 200 len: 1520 microversion: 2.1 time: 0.147060 Jun 03 09:59:29.583461 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 165/300] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:29 2022] GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5 => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:59:30.144103 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-f78a2d23-e652-47f0-93a3-f4d357ab2adc tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "POST /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.741774 Jun 03 09:59:30.144882 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 136/301] 10.222.0.45 () {60 vars in 1322 bytes} [Fri Jun 3 09:59:29 2022] POST /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f/os-volume_attachments => generated 194 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:59:30.599781 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-7782283b-a302-4c32-9242-873f0a7d041e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:30.600414 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-7782283b-a302-4c32-9242-873f0a7d041e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 59f3fa08-01f7-45d5-ae2b-171882dbc9c5] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:30.606508 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7782283b-a302-4c32-9242-873f0a7d041e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:30.606951 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7782283b-a302-4c32-9242-873f0a7d041e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:30.607711 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7782283b-a302-4c32-9242-873f0a7d041e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:30.608151 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7782283b-a302-4c32-9242-873f0a7d041e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:30.736745 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-7782283b-a302-4c32-9242-873f0a7d041e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:30.745775 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-7782283b-a302-4c32-9242-873f0a7d041e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5" status: 200 len: 1500 microversion: 2.1 time: 0.149831 Jun 03 09:59:30.746359 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 166/302] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:30 2022] GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5 => generated 1500 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:30.773377 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-d3e6b8a9-6321-4ab9-b1b1-8972231e7971 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c6fa78b3-760a-4d63-9bea-1510ab07f3d1"}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:59:30.774664 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-d3e6b8a9-6321-4ab9-b1b1-8972231e7971 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 59f3fa08-01f7-45d5-ae2b-171882dbc9c5] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:30.781008 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d3e6b8a9-6321-4ab9-b1b1-8972231e7971 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:30.781459 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d3e6b8a9-6321-4ab9-b1b1-8972231e7971 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:30.782649 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d3e6b8a9-6321-4ab9-b1b1-8972231e7971 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:30.783116 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d3e6b8a9-6321-4ab9-b1b1-8972231e7971 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:30.806630 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.wsgi [None req-d3e6b8a9-6321-4ab9-b1b1-8972231e7971 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] HTTP exception thrown: Cannot 'attach_volume' instance 59f3fa08-01f7-45d5-ae2b-171882dbc9c5 while it is in vm_state rescued Jun 03 09:59:30.808326 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-d3e6b8a9-6321-4ab9-b1b1-8972231e7971 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Request method failure captured: Jun 03 09:59:30.808326 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: request: POST /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5/os-volume_attachments HTTP/1.1 Jun 03 09:59:30.808326 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept: application/json Jun 03 09:59:30.808326 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept-Encoding: identity Jun 03 09:59:30.808326 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Connection: close Jun 03 09:59:30.808326 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Length: 74 Jun 03 09:59:30.808326 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Type: application/json Jun 03 09:59:30.808326 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Host: 10.222.0.45 Jun 03 09:59:30.808326 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Openstack-System-Scope: None Jun 03 09:59:30.808326 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: User-Agent: python-urllib3/1.26.9 Jun 03 09:59:30.808326 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Auth-Token: gAAAAABimdrfigAOeRL39EQeU8ft5oLHphkLgyvfXeq689r-FPCTJ4y9syXd_Jkm2SUwfkUx56Vaw5Abp0MA7ys2jMe9OzXPF0y6W0tmgHeUN9HmnC9ZvPbEkqx3KEqP4SzVqBlhmk1rpSp0EIzVbucLMiRYAGSLn3O0Lqt3BpdZ6R8sppypbLw Jun 03 09:59:30.808326 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Id: None Jun 03 09:59:30.808326 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Name: None Jun 03 09:59:30.808326 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Identity-Status: Confirmed Jun 03 09:59:30.808326 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Is-Admin-Project: True Jun 03 09:59:30.808326 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Id: default Jun 03 09:59:30.808326 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Name: Default Jun 03 09:59:30.808326 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Id: b96e7e1b09a04adbba3bd083328ecb71 Jun 03 09:59:30.808326 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-631686423 Jun 03 09:59:30.808326 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Role: member,reader Jun 03 09:59:30.808326 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Roles: member,reader Jun 03 09:59:30.809816 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b96e7e1b09a04adbba3bd083328ecb71", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b96e7e1b09a04adbba3bd083328ecb71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b96e7e1b09a04adbba3bd083328ecb71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b96e7e1b09a04adbba3bd083328ecb71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 09:59:30.809816 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant: tempest-ServerRescueNegativeTestJSON-631686423 Jun 03 09:59:30.809816 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Id: b96e7e1b09a04adbba3bd083328ecb71 Jun 03 09:59:30.809816 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-631686423 Jun 03 09:59:30.809816 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User: tempest-ServerRescueNegativeTestJSON-631686423-project Jun 03 09:59:30.809816 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Id: default Jun 03 09:59:30.809816 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Name: Default Jun 03 09:59:30.809816 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Id: d547e64bcf5d4799af6039df3c9a4ea6 Jun 03 09:59:30.809816 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Name: tempest-ServerRescueNegativeTestJSON-631686423-project Jun 03 09:59:30.809816 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Jun 03 09:59:30.809816 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: {"volumeAttachment": {"volumeId": "c6fa78b3-760a-4d63-9bea-1510ab07f3d1"}} Jun 03 09:59:30.809816 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: method: > Jun 03 09:59:30.810667 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: exception: Cannot 'attach_volume' instance 59f3fa08-01f7-45d5-ae2b-171882dbc9c5 while it is in vm_state rescued Jun 03 09:59:30.810667 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: action_args: {'server_id': '59f3fa08-01f7-45d5-ae2b-171882dbc9c5', 'body': {'volumeAttachment': {'volumeId': 'c6fa78b3-760a-4d63-9bea-1510ab07f3d1'}}} Jun 03 09:59:30.810667 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 09:59:30.810667 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:59:30.810667 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 03 09:59:30.810667 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 03 09:59:30.810667 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 03 09:59:30.810667 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 03 09:59:30.810667 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 03 09:59:30.810667 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 03 09:59:30.810667 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 59f3fa08-01f7-45d5-ae2b-171882dbc9c5 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 03 09:59:30.810667 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 09:59:30.810667 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:59:30.810667 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 09:59:30.810667 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:59:30.810667 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:59:30.810667 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:59:30.810667 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 09:59:30.810667 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 09:59:30.812558 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 09:59:30.812558 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 09:59:30.812558 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 09:59:30.812558 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 09:59:30.812558 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 09:59:30.812558 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 09:59:30.812558 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 09:59:30.812558 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 09:59:30.812558 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 03 09:59:30.812558 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 03 09:59:30.812558 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 03 09:59:30.812558 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 03 09:59:30.812558 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 59f3fa08-01f7-45d5-ae2b-171882dbc9c5 while it is in vm_state rescued Jun 03 09:59:30.812558 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 09:59:30.812558 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 09:59:30.812558 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 09:59:30.812558 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 09:59:30.812558 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 09:59:30.812558 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 09:59:30.813876 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 09:59:30.813876 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 09:59:30.813876 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 59f3fa08-01f7-45d5-ae2b-171882dbc9c5 while it is in vm_state rescued Jun 03 09:59:30.813876 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 09:59:30.813876 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-d3e6b8a9-6321-4ab9-b1b1-8972231e7971 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Returning 409 to user: Cannot 'attach_volume' instance 59f3fa08-01f7-45d5-ae2b-171882dbc9c5 while it is in vm_state rescued {{(pid=117648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 09:59:30.813876 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-d3e6b8a9-6321-4ab9-b1b1-8972231e7971 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "POST /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041287 Jun 03 09:59:30.813876 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 137/303] 10.222.0.45 () {60 vars in 1322 bytes} [Fri Jun 3 09:59:30 2022] POST /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5/os-volume_attachments => generated 152 bytes in 43 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 03 09:59:30.820011 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-1521cf04-8973-4840-bf49-32b01ec4c742 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:59:30.820797 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-1521cf04-8973-4840-bf49-32b01ec4c742 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 59f3fa08-01f7-45d5-ae2b-171882dbc9c5] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:30.827194 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1521cf04-8973-4840-bf49-32b01ec4c742 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:30.828268 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1521cf04-8973-4840-bf49-32b01ec4c742 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:30.829503 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1521cf04-8973-4840-bf49-32b01ec4c742 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:30.829977 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1521cf04-8973-4840-bf49-32b01ec4c742 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:30.895642 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-1521cf04-8973-4840-bf49-32b01ec4c742 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "POST /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5/action" status: 202 len: 0 microversion: 2.1 time: 0.079158 Jun 03 09:59:30.898013 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 167/304] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jun 3 09:59:30 2022] POST /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 09:59:30.904222 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-b65a40dc-a573-4ad5-9a8a-c5d269645620 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:30.904835 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-b65a40dc-a573-4ad5-9a8a-c5d269645620 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 59f3fa08-01f7-45d5-ae2b-171882dbc9c5] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:30.911655 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b65a40dc-a573-4ad5-9a8a-c5d269645620 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:30.912099 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b65a40dc-a573-4ad5-9a8a-c5d269645620 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:30.912887 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b65a40dc-a573-4ad5-9a8a-c5d269645620 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:30.913326 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b65a40dc-a573-4ad5-9a8a-c5d269645620 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:30.916559 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:59:31.049241 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-b65a40dc-a573-4ad5-9a8a-c5d269645620 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:31.057443 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-b65a40dc-a573-4ad5-9a8a-c5d269645620 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5" status: 200 len: 1508 microversion: 2.1 time: 0.156752 Jun 03 09:59:31.058141 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 138/305] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:30 2022] GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:32.076033 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-28adaafe-1505-4e5c-aca3-d8fdc41a2ce2 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:32.076743 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-28adaafe-1505-4e5c-aca3-d8fdc41a2ce2 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 59f3fa08-01f7-45d5-ae2b-171882dbc9c5] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:32.085504 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-28adaafe-1505-4e5c-aca3-d8fdc41a2ce2 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:32.086079 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-28adaafe-1505-4e5c-aca3-d8fdc41a2ce2 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:32.086927 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-28adaafe-1505-4e5c-aca3-d8fdc41a2ce2 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:32.087501 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-28adaafe-1505-4e5c-aca3-d8fdc41a2ce2 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:32.222077 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-28adaafe-1505-4e5c-aca3-d8fdc41a2ce2 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:32.229659 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-28adaafe-1505-4e5c-aca3-d8fdc41a2ce2 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5" status: 200 len: 1508 microversion: 2.1 time: 0.158063 Jun 03 09:59:32.230544 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 168/306] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:32 2022] GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5 => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:33.247556 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-2d5dcde7-de1b-46a6-a722-e5e81ff9b4d5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:33.248165 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-2d5dcde7-de1b-46a6-a722-e5e81ff9b4d5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 59f3fa08-01f7-45d5-ae2b-171882dbc9c5] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:33.255232 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2d5dcde7-de1b-46a6-a722-e5e81ff9b4d5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:33.255677 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2d5dcde7-de1b-46a6-a722-e5e81ff9b4d5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:33.256435 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2d5dcde7-de1b-46a6-a722-e5e81ff9b4d5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:33.256862 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2d5dcde7-de1b-46a6-a722-e5e81ff9b4d5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:33.394130 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-2d5dcde7-de1b-46a6-a722-e5e81ff9b4d5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:33.402465 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-2d5dcde7-de1b-46a6-a722-e5e81ff9b4d5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5" status: 200 len: 1508 microversion: 2.1 time: 0.158703 Jun 03 09:59:33.403037 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 139/307] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:33 2022] GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5 => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:34.419391 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-bc2c70e4-ce2f-419d-9f5c-8baa67589290 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:34.420117 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-bc2c70e4-ce2f-419d-9f5c-8baa67589290 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 59f3fa08-01f7-45d5-ae2b-171882dbc9c5] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:34.427257 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bc2c70e4-ce2f-419d-9f5c-8baa67589290 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:34.427717 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bc2c70e4-ce2f-419d-9f5c-8baa67589290 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:34.428495 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bc2c70e4-ce2f-419d-9f5c-8baa67589290 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:34.428936 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bc2c70e4-ce2f-419d-9f5c-8baa67589290 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:34.568989 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-bc2c70e4-ce2f-419d-9f5c-8baa67589290 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:34.576605 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-bc2c70e4-ce2f-419d-9f5c-8baa67589290 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5" status: 200 len: 1508 microversion: 2.1 time: 0.160959 Jun 03 09:59:34.577183 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 169/308] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:34 2022] GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5 => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:35.593635 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-58eb8565-f47a-4768-8024-497102d80755 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:35.594276 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-58eb8565-f47a-4768-8024-497102d80755 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 59f3fa08-01f7-45d5-ae2b-171882dbc9c5] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:35.600754 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-58eb8565-f47a-4768-8024-497102d80755 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:35.601204 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-58eb8565-f47a-4768-8024-497102d80755 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:35.601990 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-58eb8565-f47a-4768-8024-497102d80755 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:35.602428 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-58eb8565-f47a-4768-8024-497102d80755 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:35.729992 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-58eb8565-f47a-4768-8024-497102d80755 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:35.737515 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-58eb8565-f47a-4768-8024-497102d80755 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5" status: 200 len: 1508 microversion: 2.1 time: 0.148226 Jun 03 09:59:35.738094 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 140/309] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:35 2022] GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5 => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:36.753551 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-ddd92869-4f34-4c72-bbfc-ebe8f2d0e918 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:36.754194 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-ddd92869-4f34-4c72-bbfc-ebe8f2d0e918 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 59f3fa08-01f7-45d5-ae2b-171882dbc9c5] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:36.761566 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ddd92869-4f34-4c72-bbfc-ebe8f2d0e918 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:36.762430 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ddd92869-4f34-4c72-bbfc-ebe8f2d0e918 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:36.763659 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ddd92869-4f34-4c72-bbfc-ebe8f2d0e918 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:36.764113 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ddd92869-4f34-4c72-bbfc-ebe8f2d0e918 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:36.902098 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-ddd92869-4f34-4c72-bbfc-ebe8f2d0e918 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:36.910461 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-ddd92869-4f34-4c72-bbfc-ebe8f2d0e918 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5" status: 200 len: 1514 microversion: 2.1 time: 0.160803 Jun 03 09:59:36.911026 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 170/310] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:36 2022] GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:38.097880 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-7f6256cd-afc3-43d7-bf4b-6ab303471604 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:38.098425 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-7f6256cd-afc3-43d7-bf4b-6ab303471604 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:38.104854 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7f6256cd-afc3-43d7-bf4b-6ab303471604 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:38.105300 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7f6256cd-afc3-43d7-bf4b-6ab303471604 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:38.106097 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7f6256cd-afc3-43d7-bf4b-6ab303471604 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:38.106538 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7f6256cd-afc3-43d7-bf4b-6ab303471604 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:38.130666 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-7f6256cd-afc3-43d7-bf4b-6ab303471604 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f/ips" status: 200 len: 151 microversion: 2.20 time: 0.036688 Jun 03 09:59:38.131239 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 141/311] 10.222.0.45 () {60 vars in 1288 bytes} [Fri Jun 3 09:59:38 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 09:59:38.246844 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-c69ba131-194b-460c-a127-3c02d80cb702 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Action: 'create', calling method: .version_select at 0x7f50377a9040>, body: {"keypair": {"name": "tempest-keypair-1174271750", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQZ77abAXxhscv3WSH1XOxTCRbZPZGDHMoFm6IFkv1XIYzo8uT1Mb/f7xL3twWOSDMy0hieGCXq08tbg8vCy/8KsuyqiMC/+SQv3a75VS2nhj3yf946P64ETcVxQADFwQ=="}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:59:38.251330 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell0:SELECT=2 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:59:38.264466 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-c69ba131-194b-460c-a127-3c02d80cb702 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Getting quotas for project b96e7e1b09a04adbba3bd083328ecb71. Resources: {'key_pairs'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 09:59:38.269022 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-c69ba131-194b-460c-a127-3c02d80cb702 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Getting quotas for user d547e64bcf5d4799af6039df3c9a4ea6 and project b96e7e1b09a04adbba3bd083328ecb71. Resources: {'key_pairs'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 09:59:38.292346 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-c69ba131-194b-460c-a127-3c02d80cb702 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.049144 Jun 03 09:59:38.293382 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 171/312] 10.222.0.45 () {60 vars in 1158 bytes} [Fri Jun 3 09:59:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:59:39.757417 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-8da421d9-2927-40ba-a6d1-206ee652edb1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-740005873", "imageRef": "0cb3b007-4e95-448b-8acb-895d8acdb244", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b1ab1978-f76b-4220-bfdd-e128d8a1b1f5"}], "security_groups": [{"name": "tempest-securitygroup--1311004417"}], "key_name": "tempest-keypair-1174271750", "user_data": "}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:59:40.395785 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-b532c68c-54cb-4819-853e-b913e6b12aad tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:59:40.396925 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-b532c68c-54cb-4819-853e-b913e6b12aad tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:40.407774 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b532c68c-54cb-4819-853e-b913e6b12aad tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:40.408368 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b532c68c-54cb-4819-853e-b913e6b12aad tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:40.409298 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b532c68c-54cb-4819-853e-b913e6b12aad tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:40.409762 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b532c68c-54cb-4819-853e-b913e6b12aad tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:40.433645 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.objects.instance [None req-b532c68c-54cb-4819-853e-b913e6b12aad tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lazy-loading 'flavor' on Instance uuid 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f {{(pid=117647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 09:59:47.168376 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.network.neutron [None req-8da421d9-2927-40ba-a6d1-206ee652edb1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] validate_networks() for [('b1ab1978-f76b-4220-bfdd-e128d8a1b1f5', None, None, None, None, None)] {{(pid=117648) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 09:59:47.288671 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-b532c68c-54cb-4819-853e-b913e6b12aad tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "POST /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f/action" status: 202 len: 0 microversion: 2.20 time: 6.896712 Jun 03 09:59:47.289297 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 172/313] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jun 3 09:59:40 2022] POST /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f/action => generated 0 bytes in 6898 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 03 09:59:47.294689 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-10d3d017-1754-445b-b28a-709c6a57171c tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:47.295446 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-10d3d017-1754-445b-b28a-709c6a57171c tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:47.297477 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=1 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:59:47.303152 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-10d3d017-1754-445b-b28a-709c6a57171c tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:47.303632 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-10d3d017-1754-445b-b28a-709c6a57171c tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:47.304415 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-10d3d017-1754-445b-b28a-709c6a57171c tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:47.304879 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-10d3d017-1754-445b-b28a-709c6a57171c tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:47.514876 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-10d3d017-1754-445b-b28a-709c6a57171c tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:47.522817 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-10d3d017-1754-445b-b28a-709c6a57171c tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1591 microversion: 2.1 time: 0.232209 Jun 03 09:59:47.523376 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 173/314] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:47 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1591 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:47.527755 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-486fb6e5-e3f1-4b76-a668-c430d319af9c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:47.528241 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-486fb6e5-e3f1-4b76-a668-c430d319af9c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:47.534558 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-486fb6e5-e3f1-4b76-a668-c430d319af9c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:47.535015 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-486fb6e5-e3f1-4b76-a668-c430d319af9c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:47.535785 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-486fb6e5-e3f1-4b76-a668-c430d319af9c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:47.536218 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-486fb6e5-e3f1-4b76-a668-c430d319af9c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:47.560614 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-486fb6e5-e3f1-4b76-a668-c430d319af9c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e/ips" status: 200 len: 151 microversion: 2.1 time: 0.036202 Jun 03 09:59:47.566915 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 174/315] 10.222.0.45 () {58 vars in 1247 bytes} [Fri Jun 3 09:59:47 2022] GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:59:47.566915 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-f0fcd435-be43-4a31-a008-dc8030120fb5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:47.566915 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-f0fcd435-be43-4a31-a008-dc8030120fb5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:47.573698 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f0fcd435-be43-4a31-a008-dc8030120fb5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:47.574180 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f0fcd435-be43-4a31-a008-dc8030120fb5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:47.574973 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f0fcd435-be43-4a31-a008-dc8030120fb5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:47.575412 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f0fcd435-be43-4a31-a008-dc8030120fb5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:47.693850 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-8da421d9-2927-40ba-a6d1-206ee652edb1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Flavor limits 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 09:59:47.694550 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-8da421d9-2927-40ba-a6d1-206ee652edb1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Image limits 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 09:59:47.695517 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-8da421d9-2927-40ba-a6d1-206ee652edb1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Flavor pref 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 09:59:47.696118 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-8da421d9-2927-40ba-a6d1-206ee652edb1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Image pref 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 09:59:47.696720 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-8da421d9-2927-40ba-a6d1-206ee652edb1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 09:59:47.707164 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8da421d9-2927-40ba-a6d1-206ee652edb1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:47.707976 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8da421d9-2927-40ba-a6d1-206ee652edb1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:47.709191 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8da421d9-2927-40ba-a6d1-206ee652edb1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:47.709887 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8da421d9-2927-40ba-a6d1-206ee652edb1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:47.729974 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-8da421d9-2927-40ba-a6d1-206ee652edb1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Getting quotas for project b96e7e1b09a04adbba3bd083328ecb71. Resources: {'ram', 'cores', 'instances'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 09:59:47.734617 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-8da421d9-2927-40ba-a6d1-206ee652edb1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Getting quotas for user d547e64bcf5d4799af6039df3c9a4ea6 and project b96e7e1b09a04adbba3bd083328ecb71. Resources: {'ram', 'cores', 'instances'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 09:59:47.747459 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-f0fcd435-be43-4a31-a008-dc8030120fb5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:47.748998 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-8da421d9-2927-40ba-a6d1-206ee652edb1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Going to run 1 instances... {{(pid=117648) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 09:59:47.752120 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-8da421d9-2927-40ba-a6d1-206ee652edb1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0cb3b007-4e95-448b-8acb-895d8acdb244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 09:59:47.761982 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-f0fcd435-be43-4a31-a008-dc8030120fb5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:47.764134 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-f0fcd435-be43-4a31-a008-dc8030120fb5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:47.766134 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-f0fcd435-be43-4a31-a008-dc8030120fb5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1723 microversion: 2.20 time: 0.203883 Jun 03 09:59:47.767367 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 175/316] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 09:59:47 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:59:47.824628 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-8da421d9-2927-40ba-a6d1-206ee652edb1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 8.071367 Jun 03 09:59:47.829906 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 142/317] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jun 3 09:59:39 2022] POST /compute/v2.1/servers => generated 409 bytes in 8077 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 09:59:47.838649 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-9d0ef094-e9f2-4023-b4ca-c7d0fae3e287 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:47.839752 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-9d0ef094-e9f2-4023-b4ca-c7d0fae3e287 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:47.934529 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-9d0ef094-e9f2-4023-b4ca-c7d0fae3e287 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:47.942649 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-9d0ef094-e9f2-4023-b4ca-c7d0fae3e287 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6" status: 200 len: 1245 microversion: 2.1 time: 0.109455 Jun 03 09:59:47.943225 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 176/318] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:47 2022] GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 => generated 1245 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:48.785187 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-1bccc271-7c06-42d2-af7a-9356c6453101 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:48.785830 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-1bccc271-7c06-42d2-af7a-9356c6453101 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:48.792257 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1bccc271-7c06-42d2-af7a-9356c6453101 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:48.792687 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1bccc271-7c06-42d2-af7a-9356c6453101 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:48.793586 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1bccc271-7c06-42d2-af7a-9356c6453101 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:48.794050 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1bccc271-7c06-42d2-af7a-9356c6453101 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:48.959531 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-22f0d1bb-0186-4831-9281-ace8b33006bd tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:48.960834 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-22f0d1bb-0186-4831-9281-ace8b33006bd tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:49.041783 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-22f0d1bb-0186-4831-9281-ace8b33006bd tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:49.047044 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-1bccc271-7c06-42d2-af7a-9356c6453101 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:49.049364 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-22f0d1bb-0186-4831-9281-ace8b33006bd tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6" status: 200 len: 1245 microversion: 2.1 time: 0.093673 Jun 03 09:59:49.050031 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 177/319] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:48 2022] GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 => generated 1245 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:59:49.055008 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-4716229f-8130-426a-a0dd-5afa50b2623f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8047f5e-515b-42fd-bd16-343ccd47c9e6"}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:59:49.056362 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-4716229f-8130-426a-a0dd-5afa50b2623f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:49.064246 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-1bccc271-7c06-42d2-af7a-9356c6453101 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:49.064593 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4716229f-8130-426a-a0dd-5afa50b2623f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:49.065141 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4716229f-8130-426a-a0dd-5afa50b2623f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:49.066151 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4716229f-8130-426a-a0dd-5afa50b2623f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:49.066755 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4716229f-8130-426a-a0dd-5afa50b2623f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:49.075317 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-1bccc271-7c06-42d2-af7a-9356c6453101 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:49.076734 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-1bccc271-7c06-42d2-af7a-9356c6453101 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1723 microversion: 2.20 time: 0.296207 Jun 03 09:59:49.077421 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 143/320] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 09:59:48 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1723 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:59:49.146406 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:59:49.436753 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-4716229f-8130-426a-a0dd-5afa50b2623f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "POST /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.385248 Jun 03 09:59:49.437485 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 178/321] 10.222.0.45 () {60 vars in 1322 bytes} [Fri Jun 3 09:59:49 2022] POST /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e/os-volume_attachments => generated 194 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:59:49.798168 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-b8f318ae-b8f2-4cab-b5e2-a7621b7f8f35 req-b36285f5-3a56-4711-a12e-98a6371fe662 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef716191-e303-4e00-a92c-78d4fb06063f", "tag": "1567f4c3-0049-47d8-914a-22f5172d29dc"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:59:49.806960 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-b8f318ae-b8f2-4cab-b5e2-a7621b7f8f35 req-b36285f5-3a56-4711-a12e-98a6371fe662 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:49.807401 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-b8f318ae-b8f2-4cab-b5e2-a7621b7f8f35 req-b36285f5-3a56-4711-a12e-98a6371fe662 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:49.819898 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-b8f318ae-b8f2-4cab-b5e2-a7621b7f8f35 req-b36285f5-3a56-4711-a12e-98a6371fe662 service nova] Creating event network-changed:1567f4c3-0049-47d8-914a-22f5172d29dc for instance ef716191-e303-4e00-a92c-78d4fb06063f on hv-cinder-79760 Jun 03 09:59:49.825636 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-b8f318ae-b8f2-4cab-b5e2-a7621b7f8f35 req-b36285f5-3a56-4711-a12e-98a6371fe662 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030991 Jun 03 09:59:49.826305 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 144/322] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 09:59:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:59:50.070791 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-34974e53-4d3e-40e1-a814-d13dc398b7a5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:50.072600 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-34974e53-4d3e-40e1-a814-d13dc398b7a5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:50.096941 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-ff2a3acb-e106-4b7c-adad-43e1d4184f90 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:50.097646 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-ff2a3acb-e106-4b7c-adad-43e1d4184f90 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:50.116121 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ff2a3acb-e106-4b7c-adad-43e1d4184f90 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:50.116737 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ff2a3acb-e106-4b7c-adad-43e1d4184f90 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:50.123922 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ff2a3acb-e106-4b7c-adad-43e1d4184f90 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:50.124514 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ff2a3acb-e106-4b7c-adad-43e1d4184f90 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:50.136166 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-34974e53-4d3e-40e1-a814-d13dc398b7a5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:50.144207 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-34974e53-4d3e-40e1-a814-d13dc398b7a5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6" status: 200 len: 1245 microversion: 2.1 time: 0.081977 Jun 03 09:59:50.144774 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 179/323] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:50 2022] GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:50.291736 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-ff2a3acb-e106-4b7c-adad-43e1d4184f90 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:50.300389 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-ff2a3acb-e106-4b7c-adad-43e1d4184f90 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:50.302063 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-ff2a3acb-e106-4b7c-adad-43e1d4184f90 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:50.303250 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-ff2a3acb-e106-4b7c-adad-43e1d4184f90 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1723 microversion: 2.20 time: 0.210535 Jun 03 09:59:50.303813 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 145/324] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 09:59:50 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:59:51.110040 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-636eff82-5c35-4da6-bace-dc6811308e5d tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-994629307"}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:59:51.110678 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-636eff82-5c35-4da6-bace-dc6811308e5d tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:51.127451 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-636eff82-5c35-4da6-bace-dc6811308e5d tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:51.137838 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-636eff82-5c35-4da6-bace-dc6811308e5d tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:51.139080 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-636eff82-5c35-4da6-bace-dc6811308e5d tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:51.139349 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-636eff82-5c35-4da6-bace-dc6811308e5d tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:51.174407 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-5e371ce2-a221-4443-a4f4-67492ed0baa9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:51.175038 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-5e371ce2-a221-4443-a4f4-67492ed0baa9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:51.242425 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-5e371ce2-a221-4443-a4f4-67492ed0baa9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:51.252372 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-5e371ce2-a221-4443-a4f4-67492ed0baa9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6" status: 200 len: 1245 microversion: 2.1 time: 0.095654 Jun 03 09:59:51.252962 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 146/325] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:51 2022] GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 => generated 1245 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:59:51.320972 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.network.security_group_api [None req-636eff82-5c35-4da6-bace-dc6811308e5d tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Adding security group ebfe230a-212b-464f-bfbf-66217d09301d to port 1567f4c3-0049-47d8-914a-22f5172d29dc Jun 03 09:59:51.321921 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-cc8e7b77-bd3d-429d-8a31-833b899817e7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:51.322541 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-cc8e7b77-bd3d-429d-8a31-833b899817e7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:51.329645 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cc8e7b77-bd3d-429d-8a31-833b899817e7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:51.330147 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cc8e7b77-bd3d-429d-8a31-833b899817e7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:51.330924 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cc8e7b77-bd3d-429d-8a31-833b899817e7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:51.331366 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cc8e7b77-bd3d-429d-8a31-833b899817e7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:51.570371 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-cc8e7b77-bd3d-429d-8a31-833b899817e7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:51.578564 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-cc8e7b77-bd3d-429d-8a31-833b899817e7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:51.580739 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-cc8e7b77-bd3d-429d-8a31-833b899817e7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:51.581926 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-cc8e7b77-bd3d-429d-8a31-833b899817e7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1723 microversion: 2.20 time: 0.264624 Jun 03 09:59:51.593116 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 147/326] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 09:59:51 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1723 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:59:51.827193 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-636eff82-5c35-4da6-bace-dc6811308e5d tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "POST /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f/action" status: 202 len: 0 microversion: 2.1 time: 0.721420 Jun 03 09:59:51.831160 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 180/327] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jun 3 09:59:51 2022] POST /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f/action => generated 0 bytes in 726 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 09:59:51.840096 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-21950282-923c-4a99-b094-9b6dbc71a043 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:51.844302 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-21950282-923c-4a99-b094-9b6dbc71a043 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:51.850318 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-21950282-923c-4a99-b094-9b6dbc71a043 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:51.850929 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-21950282-923c-4a99-b094-9b6dbc71a043 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:51.851758 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-21950282-923c-4a99-b094-9b6dbc71a043 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:51.851861 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-987e531f-fb39-4ed2-859d-57590cd38864 req-2684069b-3e0b-4da4-8df6-946ac689d407 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef716191-e303-4e00-a92c-78d4fb06063f", "tag": "1567f4c3-0049-47d8-914a-22f5172d29dc"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:59:51.852161 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-21950282-923c-4a99-b094-9b6dbc71a043 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:51.864718 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-987e531f-fb39-4ed2-859d-57590cd38864 req-2684069b-3e0b-4da4-8df6-946ac689d407 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:51.865165 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-987e531f-fb39-4ed2-859d-57590cd38864 req-2684069b-3e0b-4da4-8df6-946ac689d407 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:51.900519 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-987e531f-fb39-4ed2-859d-57590cd38864 req-2684069b-3e0b-4da4-8df6-946ac689d407 service nova] Creating event network-changed:1567f4c3-0049-47d8-914a-22f5172d29dc for instance ef716191-e303-4e00-a92c-78d4fb06063f on hv-cinder-79760 Jun 03 09:59:51.906191 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-987e531f-fb39-4ed2-859d-57590cd38864 req-2684069b-3e0b-4da4-8df6-946ac689d407 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062776 Jun 03 09:59:51.907780 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 181/328] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 09:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:59:52.030809 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-21950282-923c-4a99-b094-9b6dbc71a043 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:52.045082 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-21950282-923c-4a99-b094-9b6dbc71a043 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1756 microversion: 2.1 time: 0.208599 Jun 03 09:59:52.060330 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 148/329] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:51 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1756 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:52.269541 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-181dcda6-fe09-48fe-8a70-d96a374a824d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:52.270922 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-181dcda6-fe09-48fe-8a70-d96a374a824d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:52.277541 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-181dcda6-fe09-48fe-8a70-d96a374a824d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:52.278239 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-181dcda6-fe09-48fe-8a70-d96a374a824d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:52.279024 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-181dcda6-fe09-48fe-8a70-d96a374a824d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:52.279470 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-181dcda6-fe09-48fe-8a70-d96a374a824d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:52.346285 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-181dcda6-fe09-48fe-8a70-d96a374a824d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:52.362783 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-181dcda6-fe09-48fe-8a70-d96a374a824d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6" status: 200 len: 1249 microversion: 2.1 time: 0.097769 Jun 03 09:59:52.364040 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 182/330] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:52 2022] GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 => generated 1249 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:52.602105 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-1f31fe0f-d0f7-404f-ae3a-32e0631e67c1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:52.603413 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-1f31fe0f-d0f7-404f-ae3a-32e0631e67c1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:52.613419 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1f31fe0f-d0f7-404f-ae3a-32e0631e67c1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:52.614440 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1f31fe0f-d0f7-404f-ae3a-32e0631e67c1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:52.616278 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1f31fe0f-d0f7-404f-ae3a-32e0631e67c1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:52.616873 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1f31fe0f-d0f7-404f-ae3a-32e0631e67c1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:52.788590 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-1f31fe0f-d0f7-404f-ae3a-32e0631e67c1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:52.796482 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-1f31fe0f-d0f7-404f-ae3a-32e0631e67c1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:52.798052 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-1f31fe0f-d0f7-404f-ae3a-32e0631e67c1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:52.799222 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-1f31fe0f-d0f7-404f-ae3a-32e0631e67c1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1723 microversion: 2.20 time: 0.202173 Jun 03 09:59:52.799784 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 149/331] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 09:59:52 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:59:53.379660 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-de41343e-1475-4d4a-a6bb-9658acaff6e4 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:53.380270 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-de41343e-1475-4d4a-a6bb-9658acaff6e4 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:53.386982 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-de41343e-1475-4d4a-a6bb-9658acaff6e4 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:53.387428 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-de41343e-1475-4d4a-a6bb-9658acaff6e4 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:53.388188 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-de41343e-1475-4d4a-a6bb-9658acaff6e4 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:53.388616 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-de41343e-1475-4d4a-a6bb-9658acaff6e4 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:53.452387 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-de41343e-1475-4d4a-a6bb-9658acaff6e4 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:53.460193 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-de41343e-1475-4d4a-a6bb-9658acaff6e4 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6" status: 200 len: 1297 microversion: 2.1 time: 0.084377 Jun 03 09:59:53.460757 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 183/332] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:53 2022] GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 => generated 1297 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:53.817838 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-9c3dcef5-96f6-4bd6-a41b-8ddc26bfc21c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:53.818446 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-9c3dcef5-96f6-4bd6-a41b-8ddc26bfc21c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:53.820862 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:59:53.826318 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9c3dcef5-96f6-4bd6-a41b-8ddc26bfc21c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:53.826771 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9c3dcef5-96f6-4bd6-a41b-8ddc26bfc21c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:53.827537 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9c3dcef5-96f6-4bd6-a41b-8ddc26bfc21c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:53.827976 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9c3dcef5-96f6-4bd6-a41b-8ddc26bfc21c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:53.963159 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-9c3dcef5-96f6-4bd6-a41b-8ddc26bfc21c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:53.972062 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-9c3dcef5-96f6-4bd6-a41b-8ddc26bfc21c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:53.974159 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-9c3dcef5-96f6-4bd6-a41b-8ddc26bfc21c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:53.976269 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-9c3dcef5-96f6-4bd6-a41b-8ddc26bfc21c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1723 microversion: 2.20 time: 0.161642 Jun 03 09:59:53.976829 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 150/333] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 09:59:53 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:59:54.476642 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-40b44e74-0ba3-46f0-9dd8-64f2ffa6a0ac tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:54.477258 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-40b44e74-0ba3-46f0-9dd8-64f2ffa6a0ac tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:54.483991 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-40b44e74-0ba3-46f0-9dd8-64f2ffa6a0ac tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:54.484446 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-40b44e74-0ba3-46f0-9dd8-64f2ffa6a0ac tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:54.485251 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-40b44e74-0ba3-46f0-9dd8-64f2ffa6a0ac tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:54.485688 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-40b44e74-0ba3-46f0-9dd8-64f2ffa6a0ac tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:54.548013 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-40b44e74-0ba3-46f0-9dd8-64f2ffa6a0ac tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:54.559567 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-40b44e74-0ba3-46f0-9dd8-64f2ffa6a0ac tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6" status: 200 len: 1303 microversion: 2.1 time: 0.086775 Jun 03 09:59:54.560137 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 184/334] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:54 2022] GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 => generated 1303 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:54.659240 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-c4c6dfb5-f5e7-4e32-9527-f9a02ad5fdf2 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-525510896", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1925739570", "security_groups": [{"name": "tempest-secgroup-smoke-995574160"}], "block_device_mapping_v2": [{"uuid": "0809805e-3e72-4d8a-8ba1-c26645686508", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3d3b7b1c-cd6f-47da-b640-3c098fa81e51"}]}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:59:54.777697 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.network.neutron [None req-c4c6dfb5-f5e7-4e32-9527-f9a02ad5fdf2 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] validate_networks() for [('3d3b7b1c-cd6f-47da-b640-3c098fa81e51', None, None, None, None, None)] {{(pid=117648) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 09:59:55.000433 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-21c660be-b2f6-4df4-881e-e2cd0750798c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:55.002797 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-21c660be-b2f6-4df4-881e-e2cd0750798c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:55.018507 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-21c660be-b2f6-4df4-881e-e2cd0750798c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:55.019283 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-21c660be-b2f6-4df4-881e-e2cd0750798c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:55.020270 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-21c660be-b2f6-4df4-881e-e2cd0750798c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:55.020866 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-21c660be-b2f6-4df4-881e-e2cd0750798c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:55.259772 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-21c660be-b2f6-4df4-881e-e2cd0750798c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:55.268915 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-21c660be-b2f6-4df4-881e-e2cd0750798c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:55.270489 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-21c660be-b2f6-4df4-881e-e2cd0750798c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:55.271661 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-21c660be-b2f6-4df4-881e-e2cd0750798c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1723 microversion: 2.20 time: 0.280898 Jun 03 09:59:55.283268 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 185/335] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 09:59:54 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1723 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 09:59:55.283589 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-c4c6dfb5-f5e7-4e32-9527-f9a02ad5fdf2 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Flavor limits 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 09:59:55.283589 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-c4c6dfb5-f5e7-4e32-9527-f9a02ad5fdf2 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Image limits 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 09:59:55.283589 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-c4c6dfb5-f5e7-4e32-9527-f9a02ad5fdf2 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Flavor pref 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 09:59:55.283589 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-c4c6dfb5-f5e7-4e32-9527-f9a02ad5fdf2 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Image pref 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 09:59:55.283589 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-c4c6dfb5-f5e7-4e32-9527-f9a02ad5fdf2 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 09:59:55.289892 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c4c6dfb5-f5e7-4e32-9527-f9a02ad5fdf2 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:55.290565 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c4c6dfb5-f5e7-4e32-9527-f9a02ad5fdf2 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:55.291575 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c4c6dfb5-f5e7-4e32-9527-f9a02ad5fdf2 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:55.292019 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c4c6dfb5-f5e7-4e32-9527-f9a02ad5fdf2 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:55.311809 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-c4c6dfb5-f5e7-4e32-9527-f9a02ad5fdf2 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Getting quotas for project 8a878ecfb9cd47b684c027beb6ad0b03. Resources: {'ram', 'cores', 'instances'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 09:59:55.318072 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-c4c6dfb5-f5e7-4e32-9527-f9a02ad5fdf2 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Getting quotas for user 397ff11fedcc4d17867e1d9c10fcd10f and project 8a878ecfb9cd47b684c027beb6ad0b03. Resources: {'ram', 'cores', 'instances'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 09:59:55.398222 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-c4c6dfb5-f5e7-4e32-9527-f9a02ad5fdf2 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Going to run 1 instances... {{(pid=117648) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 09:59:55.400405 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-c4c6dfb5-f5e7-4e32-9527-f9a02ad5fdf2 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: ac4d607d-8ff8-4931-b17d-460fda9c0917] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0809805e-3e72-4d8a-8ba1-c26645686508',volume_size=None,volume_type=None)] {{(pid=117648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 09:59:55.530682 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-c4c6dfb5-f5e7-4e32-9527-f9a02ad5fdf2 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.875468 Jun 03 09:59:55.532285 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 151/336] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jun 3 09:59:54 2022] POST /compute/v2.1/servers => generated 405 bytes in 878 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 09:59:55.542575 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-abdaae93-7b0d-4091-a8f1-3e22cbe7c777 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:55.543257 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-abdaae93-7b0d-4091-a8f1-3e22cbe7c777 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: ac4d607d-8ff8-4931-b17d-460fda9c0917] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:55.580099 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-f8f93ef9-0ff6-40af-84ef-c1f285ae4436 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:55.581031 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-f8f93ef9-0ff6-40af-84ef-c1f285ae4436 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:55.589650 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f8f93ef9-0ff6-40af-84ef-c1f285ae4436 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:55.590330 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f8f93ef9-0ff6-40af-84ef-c1f285ae4436 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:55.591484 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f8f93ef9-0ff6-40af-84ef-c1f285ae4436 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:55.593476 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f8f93ef9-0ff6-40af-84ef-c1f285ae4436 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:55.602914 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-abdaae93-7b0d-4091-a8f1-3e22cbe7c777 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:55.610707 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-abdaae93-7b0d-4091-a8f1-3e22cbe7c777 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917" status: 200 len: 1094 microversion: 2.1 time: 0.071724 Jun 03 09:59:55.620871 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 186/337] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:55 2022] GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917 => generated 1094 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:55.763898 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f8f93ef9-0ff6-40af-84ef-c1f285ae4436 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:55.772481 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-f8f93ef9-0ff6-40af-84ef-c1f285ae4436 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6" status: 200 len: 1371 microversion: 2.1 time: 0.199487 Jun 03 09:59:55.773068 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 152/338] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:55 2022] GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 => generated 1371 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:59:55.904565 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-f083347c-49b4-4429-9888-a399eab6e815 req-5b55c635-7430-4270-8986-68d8f9b01887 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd6f7d78-98ab-4e91-83cd-fae19bd9bae6", "tag": "188b0350-b3f9-4bd3-92de-c42a02aaa09f"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 09:59:55.917909 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-f083347c-49b4-4429-9888-a399eab6e815 req-5b55c635-7430-4270-8986-68d8f9b01887 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:55.918598 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-f083347c-49b4-4429-9888-a399eab6e815 req-5b55c635-7430-4270-8986-68d8f9b01887 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:55.931515 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-f083347c-49b4-4429-9888-a399eab6e815 req-5b55c635-7430-4270-8986-68d8f9b01887 service nova] Creating event network-changed:188b0350-b3f9-4bd3-92de-c42a02aaa09f for instance fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 on hv-cinder-79760 Jun 03 09:59:55.948001 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-f083347c-49b4-4429-9888-a399eab6e815 req-5b55c635-7430-4270-8986-68d8f9b01887 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047768 Jun 03 09:59:55.949974 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 187/339] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 09:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 09:59:56.291204 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-948ac722-14a1-4b9e-b394-9418f32a878d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:56.291990 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-948ac722-14a1-4b9e-b394-9418f32a878d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:56.299838 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-948ac722-14a1-4b9e-b394-9418f32a878d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:56.300462 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-948ac722-14a1-4b9e-b394-9418f32a878d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:56.301341 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-948ac722-14a1-4b9e-b394-9418f32a878d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:56.301910 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-948ac722-14a1-4b9e-b394-9418f32a878d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:56.471448 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-948ac722-14a1-4b9e-b394-9418f32a878d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:56.479307 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-948ac722-14a1-4b9e-b394-9418f32a878d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:56.480811 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-948ac722-14a1-4b9e-b394-9418f32a878d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:56.481994 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-948ac722-14a1-4b9e-b394-9418f32a878d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1723 microversion: 2.20 time: 0.194776 Jun 03 09:59:56.482713 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 153/340] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 09:59:56 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:59:56.628568 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-e2cea4d7-94a1-4d2f-ad6f-2961d9592454 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:56.629363 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-e2cea4d7-94a1-4d2f-ad6f-2961d9592454 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: ac4d607d-8ff8-4931-b17d-460fda9c0917] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:56.635579 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e2cea4d7-94a1-4d2f-ad6f-2961d9592454 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:56.636039 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e2cea4d7-94a1-4d2f-ad6f-2961d9592454 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:56.636803 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e2cea4d7-94a1-4d2f-ad6f-2961d9592454 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:56.637249 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e2cea4d7-94a1-4d2f-ad6f-2961d9592454 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:56.699561 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-e2cea4d7-94a1-4d2f-ad6f-2961d9592454 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:56.707784 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-e2cea4d7-94a1-4d2f-ad6f-2961d9592454 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917" status: 200 len: 1192 microversion: 2.1 time: 0.083824 Jun 03 09:59:56.708346 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 188/341] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:56 2022] GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917 => generated 1192 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:56.788907 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-39ac6b9a-46b6-4aba-9f76-985d6b10f782 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:56.789512 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-39ac6b9a-46b6-4aba-9f76-985d6b10f782 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:56.795593 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-39ac6b9a-46b6-4aba-9f76-985d6b10f782 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:56.796030 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-39ac6b9a-46b6-4aba-9f76-985d6b10f782 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:56.796780 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-39ac6b9a-46b6-4aba-9f76-985d6b10f782 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:56.797305 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-39ac6b9a-46b6-4aba-9f76-985d6b10f782 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:56.931223 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-39ac6b9a-46b6-4aba-9f76-985d6b10f782 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:56.940493 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-39ac6b9a-46b6-4aba-9f76-985d6b10f782 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6" status: 200 len: 1371 microversion: 2.1 time: 0.155366 Jun 03 09:59:56.941070 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 154/342] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:56 2022] GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:57.506135 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-7a6b1fd2-bc21-43ea-8d6c-548c10e39cc8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:57.506743 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-7a6b1fd2-bc21-43ea-8d6c-548c10e39cc8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:57.517620 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7a6b1fd2-bc21-43ea-8d6c-548c10e39cc8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:57.518124 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7a6b1fd2-bc21-43ea-8d6c-548c10e39cc8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:57.518905 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7a6b1fd2-bc21-43ea-8d6c-548c10e39cc8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:57.519347 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7a6b1fd2-bc21-43ea-8d6c-548c10e39cc8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:57.649150 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-7a6b1fd2-bc21-43ea-8d6c-548c10e39cc8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:57.658304 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-7a6b1fd2-bc21-43ea-8d6c-548c10e39cc8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:57.659953 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-7a6b1fd2-bc21-43ea-8d6c-548c10e39cc8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:57.661106 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-7a6b1fd2-bc21-43ea-8d6c-548c10e39cc8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1723 microversion: 2.20 time: 0.159107 Jun 03 09:59:57.661646 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 189/343] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 09:59:57 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:59:57.724779 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-c40caa63-1a50-4d29-a05a-a537f6a4f503 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:57.725413 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-c40caa63-1a50-4d29-a05a-a537f6a4f503 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: ac4d607d-8ff8-4931-b17d-460fda9c0917] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:57.731974 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c40caa63-1a50-4d29-a05a-a537f6a4f503 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:57.732430 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c40caa63-1a50-4d29-a05a-a537f6a4f503 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:57.733199 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c40caa63-1a50-4d29-a05a-a537f6a4f503 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:57.733642 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c40caa63-1a50-4d29-a05a-a537f6a4f503 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:57.794975 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-c40caa63-1a50-4d29-a05a-a537f6a4f503 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:57.802470 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-c40caa63-1a50-4d29-a05a-a537f6a4f503 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917" status: 200 len: 1200 microversion: 2.1 time: 0.081500 Jun 03 09:59:57.803040 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 155/344] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:57 2022] GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917 => generated 1200 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:57.956968 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-4cbf9131-6809-442d-9f9e-d4ade568fb8a tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:57.957578 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-4cbf9131-6809-442d-9f9e-d4ade568fb8a tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:57.965918 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4cbf9131-6809-442d-9f9e-d4ade568fb8a tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:57.966658 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4cbf9131-6809-442d-9f9e-d4ade568fb8a tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:57.968054 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4cbf9131-6809-442d-9f9e-d4ade568fb8a tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:57.968773 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4cbf9131-6809-442d-9f9e-d4ade568fb8a tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:58.202558 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-4cbf9131-6809-442d-9f9e-d4ade568fb8a tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:58.211082 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-4cbf9131-6809-442d-9f9e-d4ade568fb8a tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6" status: 200 len: 1371 microversion: 2.1 time: 0.258055 Jun 03 09:59:58.211859 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 190/345] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:57 2022] GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 => generated 1371 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:59:58.680594 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-254da7b2-1529-4808-91d0-af3147607c08 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:58.681217 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-254da7b2-1529-4808-91d0-af3147607c08 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:58.692911 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-254da7b2-1529-4808-91d0-af3147607c08 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:58.693360 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-254da7b2-1529-4808-91d0-af3147607c08 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:58.694359 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-254da7b2-1529-4808-91d0-af3147607c08 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:58.694790 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-254da7b2-1529-4808-91d0-af3147607c08 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:58.819722 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-97815376-24c6-4444-9ae4-3355cb9d0af7 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:58.820458 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-97815376-24c6-4444-9ae4-3355cb9d0af7 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: ac4d607d-8ff8-4931-b17d-460fda9c0917] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:58.826240 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-254da7b2-1529-4808-91d0-af3147607c08 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:58.827326 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-97815376-24c6-4444-9ae4-3355cb9d0af7 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:58.827774 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-97815376-24c6-4444-9ae4-3355cb9d0af7 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:58.828544 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-97815376-24c6-4444-9ae4-3355cb9d0af7 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:58.828981 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-97815376-24c6-4444-9ae4-3355cb9d0af7 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:58.834442 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-254da7b2-1529-4808-91d0-af3147607c08 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:58.836049 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-254da7b2-1529-4808-91d0-af3147607c08 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:58.837200 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-254da7b2-1529-4808-91d0-af3147607c08 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1723 microversion: 2.20 time: 0.160966 Jun 03 09:59:58.837782 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 156/346] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 09:59:58 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 09:59:58.888697 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-97815376-24c6-4444-9ae4-3355cb9d0af7 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:58.896182 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-97815376-24c6-4444-9ae4-3355cb9d0af7 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917" status: 200 len: 1210 microversion: 2.1 time: 0.080245 Jun 03 09:59:58.896746 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 191/347] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:58 2022] GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917 => generated 1210 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 09:59:59.228297 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-16532cf7-3664-4b74-a96a-3d75ddc0a7bb tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:59.228902 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-16532cf7-3664-4b74-a96a-3d75ddc0a7bb tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:59.235436 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-16532cf7-3664-4b74-a96a-3d75ddc0a7bb tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:59.235887 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-16532cf7-3664-4b74-a96a-3d75ddc0a7bb tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:59.236644 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-16532cf7-3664-4b74-a96a-3d75ddc0a7bb tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:59.237076 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-16532cf7-3664-4b74-a96a-3d75ddc0a7bb tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:59.370868 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-16532cf7-3664-4b74-a96a-3d75ddc0a7bb tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 09:59:59.378338 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-16532cf7-3664-4b74-a96a-3d75ddc0a7bb tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6" status: 200 len: 1371 microversion: 2.1 time: 0.153792 Jun 03 09:59:59.378909 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 157/348] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:59 2022] GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 09:59:59.855088 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-a907e66b-349a-4d81-bca9-fbbe942dcd46 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:59.855627 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-a907e66b-349a-4d81-bca9-fbbe942dcd46 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:59.862259 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a907e66b-349a-4d81-bca9-fbbe942dcd46 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:59.862711 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a907e66b-349a-4d81-bca9-fbbe942dcd46 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:59.863537 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a907e66b-349a-4d81-bca9-fbbe942dcd46 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:59.863979 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a907e66b-349a-4d81-bca9-fbbe942dcd46 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:59.913024 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-4ab13d0c-499c-419d-bab4-ca4e176fe0e6 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 09:59:59.913802 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-4ab13d0c-499c-419d-bab4-ca4e176fe0e6 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: ac4d607d-8ff8-4931-b17d-460fda9c0917] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 09:59:59.920271 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4ab13d0c-499c-419d-bab4-ca4e176fe0e6 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:59.920719 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4ab13d0c-499c-419d-bab4-ca4e176fe0e6 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:59.921486 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4ab13d0c-499c-419d-bab4-ca4e176fe0e6 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 09:59:59.921949 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4ab13d0c-499c-419d-bab4-ca4e176fe0e6 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 09:59:59.924567 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell1:SELECT=100 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 09:59:59.996588 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-4ab13d0c-499c-419d-bab4-ca4e176fe0e6 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:00.004437 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-4ab13d0c-499c-419d-bab4-ca4e176fe0e6 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917" status: 200 len: 1210 microversion: 2.1 time: 0.095240 Jun 03 10:00:00.005007 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 158/349] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 09:59:59 2022] GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917 => generated 1210 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:00:00.013360 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-a907e66b-349a-4d81-bca9-fbbe942dcd46 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:00.022080 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-a907e66b-349a-4d81-bca9-fbbe942dcd46 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:00.023585 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-a907e66b-349a-4d81-bca9-fbbe942dcd46 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:00.024756 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-a907e66b-349a-4d81-bca9-fbbe942dcd46 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1723 microversion: 2.20 time: 0.173656 Jun 03 10:00:00.025310 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 192/350] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 09:59:59 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1723 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:00.395106 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-a6fe0dee-a6c3-4b55-ba06-4309a20a16e2 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:00.395782 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-a6fe0dee-a6c3-4b55-ba06-4309a20a16e2 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:00.401988 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a6fe0dee-a6c3-4b55-ba06-4309a20a16e2 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:00.402522 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a6fe0dee-a6c3-4b55-ba06-4309a20a16e2 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:00.403378 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a6fe0dee-a6c3-4b55-ba06-4309a20a16e2 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:00.403873 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a6fe0dee-a6c3-4b55-ba06-4309a20a16e2 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:00.601149 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-a6fe0dee-a6c3-4b55-ba06-4309a20a16e2 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:00.613894 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-a6fe0dee-a6c3-4b55-ba06-4309a20a16e2 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6" status: 200 len: 1371 microversion: 2.1 time: 0.223156 Jun 03 10:00:00.614461 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 159/351] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:00 2022] GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 => generated 1371 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:01.020730 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-6f0607a3-adbb-425a-bd98-71a69d72b417 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:01.021348 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-6f0607a3-adbb-425a-bd98-71a69d72b417 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: ac4d607d-8ff8-4931-b17d-460fda9c0917] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:01.028385 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6f0607a3-adbb-425a-bd98-71a69d72b417 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:01.029067 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6f0607a3-adbb-425a-bd98-71a69d72b417 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:01.029968 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6f0607a3-adbb-425a-bd98-71a69d72b417 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:01.030537 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6f0607a3-adbb-425a-bd98-71a69d72b417 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:01.043098 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-4ca7ff1b-947f-4689-9615-d6e18db48f9e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:01.044304 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-4ca7ff1b-947f-4689-9615-d6e18db48f9e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:01.061028 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4ca7ff1b-947f-4689-9615-d6e18db48f9e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:01.061381 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4ca7ff1b-947f-4689-9615-d6e18db48f9e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:01.062201 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4ca7ff1b-947f-4689-9615-d6e18db48f9e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:01.063419 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4ca7ff1b-947f-4689-9615-d6e18db48f9e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:01.322508 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-6f0607a3-adbb-425a-bd98-71a69d72b417 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:01.332919 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-6f0607a3-adbb-425a-bd98-71a69d72b417 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917" status: 200 len: 1277 microversion: 2.1 time: 0.316170 Jun 03 10:00:01.342572 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 193/352] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:01 2022] GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917 => generated 1277 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:01.347616 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-8c55f72d-a2df-4843-b8ff-48f6cb0f02da tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Action: 'create', calling method: .version_select at 0x7f5036b80310>, body: {"keypair": {"name": "tempest-keypair-196741083", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQvVAdREBA6orso8hwghWIF1vqaDPc06igbmsw5OSE5CTV7Y8+QwDqLmVTYW3FaetUUZfYVNsxKJKYFVIiIAtYCpS44k9KtIT7QpU2BDutyGhzxrk+6uo+44en5PFiBGw=="}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:00:01.359269 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell0:SELECT=13 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:00:01.363059 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-8c55f72d-a2df-4843-b8ff-48f6cb0f02da tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Getting quotas for project 12d4ca628b894615bc311c3705c4a801. Resources: {'key_pairs'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 10:00:01.365149 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-4ca7ff1b-947f-4689-9615-d6e18db48f9e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:01.367964 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-8c55f72d-a2df-4843-b8ff-48f6cb0f02da tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Getting quotas for user e62d9d781281497e9927c0eb0e85dd75 and project 12d4ca628b894615bc311c3705c4a801. Resources: {'key_pairs'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 10:00:01.374250 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-4ca7ff1b-947f-4689-9615-d6e18db48f9e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:01.376340 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-4ca7ff1b-947f-4689-9615-d6e18db48f9e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:01.377565 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-4ca7ff1b-947f-4689-9615-d6e18db48f9e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1723 microversion: 2.20 time: 0.338514 Jun 03 10:00:01.378696 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 160/353] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:01 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1723 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 10:00:01.399725 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-8c55f72d-a2df-4843-b8ff-48f6cb0f02da tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.055958 Jun 03 10:00:01.400323 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 194/354] 10.222.0.45 () {60 vars in 1158 bytes} [Fri Jun 3 10:00:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:00:01.632032 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-a239d43b-cebf-4ee7-9c4e-6447300de392 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:01.632655 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-a239d43b-cebf-4ee7-9c4e-6447300de392 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:01.639644 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a239d43b-cebf-4ee7-9c4e-6447300de392 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:01.640325 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a239d43b-cebf-4ee7-9c4e-6447300de392 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:01.641699 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a239d43b-cebf-4ee7-9c4e-6447300de392 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:01.642243 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a239d43b-cebf-4ee7-9c4e-6447300de392 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:01.865722 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-a239d43b-cebf-4ee7-9c4e-6447300de392 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:01.874671 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-a239d43b-cebf-4ee7-9c4e-6447300de392 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6" status: 200 len: 1371 microversion: 2.1 time: 0.246380 Jun 03 10:00:01.875831 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 161/355] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:01 2022] GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 => generated 1371 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:02.063173 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-6fd2b6f0-d9f7-4ab0-82b4-cdb69a83687e req-256da1ad-fafa-42d3-973a-72df0111e28b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac4d607d-8ff8-4931-b17d-460fda9c0917", "tag": "f8af94cb-bdaf-478f-8c87-f417af511b7d"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:00:02.081413 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-6fd2b6f0-d9f7-4ab0-82b4-cdb69a83687e req-256da1ad-fafa-42d3-973a-72df0111e28b service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:02.085481 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-6fd2b6f0-d9f7-4ab0-82b4-cdb69a83687e req-256da1ad-fafa-42d3-973a-72df0111e28b service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:02.123648 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-6fd2b6f0-d9f7-4ab0-82b4-cdb69a83687e req-256da1ad-fafa-42d3-973a-72df0111e28b service nova] Creating event network-changed:f8af94cb-bdaf-478f-8c87-f417af511b7d for instance ac4d607d-8ff8-4931-b17d-460fda9c0917 on hv-cinder-79760 Jun 03 10:00:02.131143 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-6fd2b6f0-d9f7-4ab0-82b4-cdb69a83687e req-256da1ad-fafa-42d3-973a-72df0111e28b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072478 Jun 03 10:00:02.131825 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 195/356] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:00:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:00:02.350573 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-2987b722-0792-45c0-89c2-4364707f62c8 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:02.351753 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-2987b722-0792-45c0-89c2-4364707f62c8 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: ac4d607d-8ff8-4931-b17d-460fda9c0917] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:02.358459 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2987b722-0792-45c0-89c2-4364707f62c8 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:02.359532 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2987b722-0792-45c0-89c2-4364707f62c8 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:02.360915 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2987b722-0792-45c0-89c2-4364707f62c8 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:02.361566 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2987b722-0792-45c0-89c2-4364707f62c8 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:02.400669 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-6c8c738c-bc7f-4554-824c-65f3233b1779 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:02.401902 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-6c8c738c-bc7f-4554-824c-65f3233b1779 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:02.410238 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6c8c738c-bc7f-4554-824c-65f3233b1779 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:02.411009 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6c8c738c-bc7f-4554-824c-65f3233b1779 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:02.412218 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6c8c738c-bc7f-4554-824c-65f3233b1779 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:02.412847 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6c8c738c-bc7f-4554-824c-65f3233b1779 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:02.730926 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-2987b722-0792-45c0-89c2-4364707f62c8 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:02.735859 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-6c8c738c-bc7f-4554-824c-65f3233b1779 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:02.746833 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-6c8c738c-bc7f-4554-824c-65f3233b1779 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:02.748328 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-6c8c738c-bc7f-4554-824c-65f3233b1779 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:02.749497 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-6c8c738c-bc7f-4554-824c-65f3233b1779 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1723 microversion: 2.20 time: 0.355221 Jun 03 10:00:02.750633 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-2987b722-0792-45c0-89c2-4364707f62c8 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917" status: 200 len: 1277 microversion: 2.1 time: 0.403876 Jun 03 10:00:02.762516 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 196/357] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:02 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1723 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:02.765092 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 162/358] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:02 2022] GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917 => generated 1277 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:02.905440 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-71000bf6-077f-4fdd-90a8-5a3b289611e3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:02.906856 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-71000bf6-077f-4fdd-90a8-5a3b289611e3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:02.915730 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-71000bf6-077f-4fdd-90a8-5a3b289611e3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:02.917420 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-71000bf6-077f-4fdd-90a8-5a3b289611e3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:02.918751 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-71000bf6-077f-4fdd-90a8-5a3b289611e3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:02.919426 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-71000bf6-077f-4fdd-90a8-5a3b289611e3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:03.054308 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-eb1e64de-9c22-4b09-a58a-970d9ddd9fe9 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-442037092", "imageRef": "0cb3b007-4e95-448b-8acb-895d8acdb244", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3baa3021-e41d-411e-bddb-b3793d770962"}], "security_groups": [{"name": "tempest-securitygroup--490688840"}], "key_name": "tempest-keypair-196741083", "user_data": "}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:00:03.163266 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-71000bf6-077f-4fdd-90a8-5a3b289611e3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:03.171139 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-71000bf6-077f-4fdd-90a8-5a3b289611e3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6" status: 200 len: 1371 microversion: 2.1 time: 0.283005 Jun 03 10:00:03.171718 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 197/359] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:02 2022] GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 => generated 1371 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:03.184581 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.network.neutron [None req-eb1e64de-9c22-4b09-a58a-970d9ddd9fe9 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] validate_networks() for [('3baa3021-e41d-411e-bddb-b3793d770962', None, None, None, None, None)] {{(pid=117648) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 10:00:03.559760 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-eb1e64de-9c22-4b09-a58a-970d9ddd9fe9 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Flavor limits 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 10:00:03.560333 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-eb1e64de-9c22-4b09-a58a-970d9ddd9fe9 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Image limits 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 10:00:03.560675 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-eb1e64de-9c22-4b09-a58a-970d9ddd9fe9 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Flavor pref 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 10:00:03.561092 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-eb1e64de-9c22-4b09-a58a-970d9ddd9fe9 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Image pref 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 10:00:03.561516 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-eb1e64de-9c22-4b09-a58a-970d9ddd9fe9 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 10:00:03.570743 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-eb1e64de-9c22-4b09-a58a-970d9ddd9fe9 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:03.571194 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-eb1e64de-9c22-4b09-a58a-970d9ddd9fe9 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:03.572001 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-eb1e64de-9c22-4b09-a58a-970d9ddd9fe9 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:03.572442 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-eb1e64de-9c22-4b09-a58a-970d9ddd9fe9 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:03.589472 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-eb1e64de-9c22-4b09-a58a-970d9ddd9fe9 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Getting quotas for project 12d4ca628b894615bc311c3705c4a801. Resources: {'ram', 'cores', 'instances'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 10:00:03.593375 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-eb1e64de-9c22-4b09-a58a-970d9ddd9fe9 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Getting quotas for user e62d9d781281497e9927c0eb0e85dd75 and project 12d4ca628b894615bc311c3705c4a801. Resources: {'ram', 'cores', 'instances'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 10:00:03.604276 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-eb1e64de-9c22-4b09-a58a-970d9ddd9fe9 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Going to run 1 instances... {{(pid=117648) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 10:00:03.606400 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-eb1e64de-9c22-4b09-a58a-970d9ddd9fe9 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 2ecad1bf-3c89-4b29-a511-6e3d71a834fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0cb3b007-4e95-448b-8acb-895d8acdb244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 10:00:03.652038 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-eb1e64de-9c22-4b09-a58a-970d9ddd9fe9 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.602049 Jun 03 10:00:03.652672 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 163/360] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jun 3 10:00:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 03 10:00:03.663362 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-cfc1334a-6964-4217-91ba-8fe0b44c1908 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:03.663984 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-cfc1334a-6964-4217-91ba-8fe0b44c1908 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 2ecad1bf-3c89-4b29-a511-6e3d71a834fc] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:03.716443 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-cfc1334a-6964-4217-91ba-8fe0b44c1908 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:03.724106 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-cfc1334a-6964-4217-91ba-8fe0b44c1908 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc" status: 200 len: 1240 microversion: 2.1 time: 0.064540 Jun 03 10:00:03.724691 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 198/361] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:03 2022] GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc => generated 1240 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:03.768832 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-d0ac44b8-6d36-4a44-ac94-3ef384a2a459 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:03.769736 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-d0ac44b8-6d36-4a44-ac94-3ef384a2a459 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: ac4d607d-8ff8-4931-b17d-460fda9c0917] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:03.771301 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-6ba4b54a-860b-488c-be84-f112c8d6decd tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:03.772072 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-6ba4b54a-860b-488c-be84-f112c8d6decd tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:03.780003 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6ba4b54a-860b-488c-be84-f112c8d6decd tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:03.780177 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d0ac44b8-6d36-4a44-ac94-3ef384a2a459 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:03.780625 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d0ac44b8-6d36-4a44-ac94-3ef384a2a459 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:03.781063 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6ba4b54a-860b-488c-be84-f112c8d6decd tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:03.781691 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d0ac44b8-6d36-4a44-ac94-3ef384a2a459 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:03.781886 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d0ac44b8-6d36-4a44-ac94-3ef384a2a459 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:03.782109 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6ba4b54a-860b-488c-be84-f112c8d6decd tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:03.782961 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6ba4b54a-860b-488c-be84-f112c8d6decd tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:04.098949 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-6ba4b54a-860b-488c-be84-f112c8d6decd tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:04.102158 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d0ac44b8-6d36-4a44-ac94-3ef384a2a459 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:04.109410 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-6ba4b54a-860b-488c-be84-f112c8d6decd tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:04.110543 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-d0ac44b8-6d36-4a44-ac94-3ef384a2a459 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917" status: 200 len: 1265 microversion: 2.1 time: 0.345683 Jun 03 10:00:04.111720 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 164/362] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:03 2022] GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917 => generated 1265 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:04.111869 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-6ba4b54a-860b-488c-be84-f112c8d6decd tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:04.113072 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-6ba4b54a-860b-488c-be84-f112c8d6decd tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1723 microversion: 2.20 time: 0.347788 Jun 03 10:00:04.113621 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 199/363] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:03 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1723 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:04.189173 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-20f1058a-a7ef-4b55-847c-e11b433d13c5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:04.189813 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-20f1058a-a7ef-4b55-847c-e11b433d13c5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:04.195886 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-20f1058a-a7ef-4b55-847c-e11b433d13c5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:04.196376 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-20f1058a-a7ef-4b55-847c-e11b433d13c5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:04.197154 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-20f1058a-a7ef-4b55-847c-e11b433d13c5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:04.197592 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-20f1058a-a7ef-4b55-847c-e11b433d13c5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:04.385723 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-20f1058a-a7ef-4b55-847c-e11b433d13c5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:04.394859 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-20f1058a-a7ef-4b55-847c-e11b433d13c5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6" status: 200 len: 1371 microversion: 2.1 time: 0.209907 Jun 03 10:00:04.395633 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 165/364] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:04 2022] GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 => generated 1371 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:04.553434 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-c8ca1095-7cb5-4f91-8d6a-1f66e7f32040 req-5b3ab1f5-b0be-4bc0-b7a1-7617349594ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd6f7d78-98ab-4e91-83cd-fae19bd9bae6", "name": "network-vif-plugged", "status": "completed", "tag": "188b0350-b3f9-4bd3-92de-c42a02aaa09f"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:00:04.562300 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-c8ca1095-7cb5-4f91-8d6a-1f66e7f32040 req-5b3ab1f5-b0be-4bc0-b7a1-7617349594ce service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:04.562790 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-c8ca1095-7cb5-4f91-8d6a-1f66e7f32040 req-5b3ab1f5-b0be-4bc0-b7a1-7617349594ce service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:04.574140 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-c8ca1095-7cb5-4f91-8d6a-1f66e7f32040 req-5b3ab1f5-b0be-4bc0-b7a1-7617349594ce service nova] Creating event network-vif-plugged:188b0350-b3f9-4bd3-92de-c42a02aaa09f for instance fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 on hv-cinder-79760 Jun 03 10:00:04.579318 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-c8ca1095-7cb5-4f91-8d6a-1f66e7f32040 req-5b3ab1f5-b0be-4bc0-b7a1-7617349594ce service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030293 Jun 03 10:00:04.579903 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 200/365] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:00:04.742913 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-29b8fbf4-ad40-4f94-8976-0c2c122299d6 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:04.743466 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-29b8fbf4-ad40-4f94-8976-0c2c122299d6 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 2ecad1bf-3c89-4b29-a511-6e3d71a834fc] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:04.749441 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-29b8fbf4-ad40-4f94-8976-0c2c122299d6 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:04.749930 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-29b8fbf4-ad40-4f94-8976-0c2c122299d6 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:04.750727 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-29b8fbf4-ad40-4f94-8976-0c2c122299d6 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:04.751161 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-29b8fbf4-ad40-4f94-8976-0c2c122299d6 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:04.811944 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-29b8fbf4-ad40-4f94-8976-0c2c122299d6 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:04.819522 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-29b8fbf4-ad40-4f94-8976-0c2c122299d6 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc" status: 200 len: 1292 microversion: 2.1 time: 0.080518 Jun 03 10:00:04.820087 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 166/366] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:04 2022] GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc => generated 1292 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:05.130678 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-ad5caa2a-f6cd-44c4-b6ac-d280852517dd tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:05.131186 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-2e33c1f0-7bfd-4a63-91e0-8f848024f9b1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:05.131745 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-ad5caa2a-f6cd-44c4-b6ac-d280852517dd tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: ac4d607d-8ff8-4931-b17d-460fda9c0917] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:05.131982 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-2e33c1f0-7bfd-4a63-91e0-8f848024f9b1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:05.139180 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2e33c1f0-7bfd-4a63-91e0-8f848024f9b1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:05.139937 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2e33c1f0-7bfd-4a63-91e0-8f848024f9b1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:05.140722 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2e33c1f0-7bfd-4a63-91e0-8f848024f9b1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:05.141448 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ad5caa2a-f6cd-44c4-b6ac-d280852517dd tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:05.141796 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2e33c1f0-7bfd-4a63-91e0-8f848024f9b1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:05.142142 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ad5caa2a-f6cd-44c4-b6ac-d280852517dd tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:05.142996 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ad5caa2a-f6cd-44c4-b6ac-d280852517dd tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:05.143445 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ad5caa2a-f6cd-44c4-b6ac-d280852517dd tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:05.147730 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:00:05.438911 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-2e33c1f0-7bfd-4a63-91e0-8f848024f9b1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:05.447701 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-2e33c1f0-7bfd-4a63-91e0-8f848024f9b1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:05.449210 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-2e33c1f0-7bfd-4a63-91e0-8f848024f9b1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:05.450405 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-2e33c1f0-7bfd-4a63-91e0-8f848024f9b1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1723 microversion: 2.20 time: 0.323116 Jun 03 10:00:05.451355 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 167/367] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:05 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1723 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:05.455399 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-2e9847a9-9ec6-4385-a800-93515a28abe0 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:05.455992 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-2e9847a9-9ec6-4385-a800-93515a28abe0 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:05.462355 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2e9847a9-9ec6-4385-a800-93515a28abe0 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:05.462979 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2e9847a9-9ec6-4385-a800-93515a28abe0 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:05.463857 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-ad5caa2a-f6cd-44c4-b6ac-d280852517dd tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:05.464147 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2e9847a9-9ec6-4385-a800-93515a28abe0 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:05.464684 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2e9847a9-9ec6-4385-a800-93515a28abe0 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:05.471497 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-ad5caa2a-f6cd-44c4-b6ac-d280852517dd tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917" status: 200 len: 1265 microversion: 2.1 time: 0.347613 Jun 03 10:00:05.472067 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 201/368] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:05 2022] GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917 => generated 1265 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:05.594300 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-2e9847a9-9ec6-4385-a800-93515a28abe0 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:05.601951 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-2e9847a9-9ec6-4385-a800-93515a28abe0 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6" status: 200 len: 1371 microversion: 2.1 time: 0.149897 Jun 03 10:00:05.602610 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 168/369] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:05 2022] GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:05.836834 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-9e11b1b1-7725-46f9-8356-370ec643dd9d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:05.837328 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-9e11b1b1-7725-46f9-8356-370ec643dd9d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 2ecad1bf-3c89-4b29-a511-6e3d71a834fc] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:05.844380 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9e11b1b1-7725-46f9-8356-370ec643dd9d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:05.844834 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9e11b1b1-7725-46f9-8356-370ec643dd9d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:05.845632 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9e11b1b1-7725-46f9-8356-370ec643dd9d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:05.846187 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9e11b1b1-7725-46f9-8356-370ec643dd9d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:05.877565 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 10:00:05.877821 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Fri Jun 3 10:00:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc (ip 10.222.0.45) !!! Jun 03 10:00:05.929451 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-9e11b1b1-7725-46f9-8356-370ec643dd9d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:05.938471 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-9e11b1b1-7725-46f9-8356-370ec643dd9d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc" status: 200 len: 1298 microversion: 2.1 time: 0.105258 Jun 03 10:00:05.939197 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 202/370] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:05 2022] GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc => generated 1298 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:06.470410 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-bb56f43f-d855-49f5-a599-1c620f4c958a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:06.471028 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-bb56f43f-d855-49f5-a599-1c620f4c958a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:06.478172 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-bb56f43f-d855-49f5-a599-1c620f4c958a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:06.478726 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-bb56f43f-d855-49f5-a599-1c620f4c958a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:06.479908 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-bb56f43f-d855-49f5-a599-1c620f4c958a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:06.480541 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-bb56f43f-d855-49f5-a599-1c620f4c958a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:06.489841 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-787786c8-baa5-4429-9321-5f2cc6610cb1 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:06.490673 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-787786c8-baa5-4429-9321-5f2cc6610cb1 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: ac4d607d-8ff8-4931-b17d-460fda9c0917] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:06.497481 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-787786c8-baa5-4429-9321-5f2cc6610cb1 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:06.498243 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-787786c8-baa5-4429-9321-5f2cc6610cb1 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:06.499276 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-787786c8-baa5-4429-9321-5f2cc6610cb1 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:06.499928 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-787786c8-baa5-4429-9321-5f2cc6610cb1 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:06.978358 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-bb56f43f-d855-49f5-a599-1c620f4c958a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:06.989238 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-bb56f43f-d855-49f5-a599-1c620f4c958a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:06.990900 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-bb56f43f-d855-49f5-a599-1c620f4c958a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:06.992123 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-bb56f43f-d855-49f5-a599-1c620f4c958a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1723 microversion: 2.20 time: 0.527822 Jun 03 10:00:06.993325 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 169/371] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:06 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1723 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:06.998653 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-733337db-eed1-4f36-9193-2a4fbb9cf5b3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:06.999417 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-733337db-eed1-4f36-9193-2a4fbb9cf5b3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:07.005010 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-787786c8-baa5-4429-9321-5f2cc6610cb1 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:07.006397 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-733337db-eed1-4f36-9193-2a4fbb9cf5b3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:07.006999 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-733337db-eed1-4f36-9193-2a4fbb9cf5b3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:07.007931 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-733337db-eed1-4f36-9193-2a4fbb9cf5b3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:07.008693 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-733337db-eed1-4f36-9193-2a4fbb9cf5b3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:07.016399 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-787786c8-baa5-4429-9321-5f2cc6610cb1 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917" status: 200 len: 1265 microversion: 2.1 time: 0.530898 Jun 03 10:00:07.017248 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 203/372] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:06 2022] GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917 => generated 1265 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:07.024494 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-ee818bf4-26a6-45a7-bbee-a063965097cb tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:07.025326 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-ee818bf4-26a6-45a7-bbee-a063965097cb tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 2ecad1bf-3c89-4b29-a511-6e3d71a834fc] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:07.036149 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ee818bf4-26a6-45a7-bbee-a063965097cb tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:07.037918 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ee818bf4-26a6-45a7-bbee-a063965097cb tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:07.039104 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ee818bf4-26a6-45a7-bbee-a063965097cb tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:07.039795 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ee818bf4-26a6-45a7-bbee-a063965097cb tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:07.311703 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-ee818bf4-26a6-45a7-bbee-a063965097cb tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:07.322872 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-ee818bf4-26a6-45a7-bbee-a063965097cb tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc" status: 200 len: 1365 microversion: 2.1 time: 0.304235 Jun 03 10:00:07.333476 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-733337db-eed1-4f36-9193-2a4fbb9cf5b3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:07.333589 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 204/373] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:07 2022] GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc => generated 1365 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:07.339497 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-733337db-eed1-4f36-9193-2a4fbb9cf5b3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6" status: 200 len: 1371 microversion: 2.1 time: 0.344857 Jun 03 10:00:07.350700 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 170/374] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:06 2022] GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 => generated 1371 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:08.010288 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-0d9f0358-b9af-441b-9192-be622b8f38cb tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:08.010895 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-0d9f0358-b9af-441b-9192-be622b8f38cb tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:08.017829 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0d9f0358-b9af-441b-9192-be622b8f38cb tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:08.018275 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0d9f0358-b9af-441b-9192-be622b8f38cb tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:08.019028 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0d9f0358-b9af-441b-9192-be622b8f38cb tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:08.019460 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0d9f0358-b9af-441b-9192-be622b8f38cb tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:08.034792 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-f07853d4-5a3b-4b02-9917-b214ffc5ac8c tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:08.035936 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-f07853d4-5a3b-4b02-9917-b214ffc5ac8c tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: ac4d607d-8ff8-4931-b17d-460fda9c0917] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:08.042485 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f07853d4-5a3b-4b02-9917-b214ffc5ac8c tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:08.042943 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f07853d4-5a3b-4b02-9917-b214ffc5ac8c tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:08.043745 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f07853d4-5a3b-4b02-9917-b214ffc5ac8c tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:08.044189 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f07853d4-5a3b-4b02-9917-b214ffc5ac8c tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:08.215621 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-0d9f0358-b9af-441b-9192-be622b8f38cb tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:08.223999 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-0d9f0358-b9af-441b-9192-be622b8f38cb tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:08.224158 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f07853d4-5a3b-4b02-9917-b214ffc5ac8c tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:08.225486 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-0d9f0358-b9af-441b-9192-be622b8f38cb tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:08.226662 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-0d9f0358-b9af-441b-9192-be622b8f38cb tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1723 microversion: 2.20 time: 0.220255 Jun 03 10:00:08.227219 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 205/375] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:08 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:08.231913 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-f07853d4-5a3b-4b02-9917-b214ffc5ac8c tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917" status: 200 len: 1265 microversion: 2.1 time: 0.201862 Jun 03 10:00:08.232549 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 171/376] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:08 2022] GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917 => generated 1265 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:00:08.340318 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-2c16d4d6-0f27-4c4c-bd5c-f190730ea97d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:08.340861 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-2c16d4d6-0f27-4c4c-bd5c-f190730ea97d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 2ecad1bf-3c89-4b29-a511-6e3d71a834fc] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:08.346895 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2c16d4d6-0f27-4c4c-bd5c-f190730ea97d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:08.347343 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2c16d4d6-0f27-4c4c-bd5c-f190730ea97d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:08.348101 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2c16d4d6-0f27-4c4c-bd5c-f190730ea97d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:08.348533 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2c16d4d6-0f27-4c4c-bd5c-f190730ea97d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:08.356109 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-249bb9de-c63e-4dca-96ab-82e587c1f0e6 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:08.356756 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-249bb9de-c63e-4dca-96ab-82e587c1f0e6 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:08.363300 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-249bb9de-c63e-4dca-96ab-82e587c1f0e6 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:08.363300 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-249bb9de-c63e-4dca-96ab-82e587c1f0e6 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:08.364089 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-249bb9de-c63e-4dca-96ab-82e587c1f0e6 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:08.364585 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-249bb9de-c63e-4dca-96ab-82e587c1f0e6 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:08.610848 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-2c16d4d6-0f27-4c4c-bd5c-f190730ea97d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:08.626069 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-2c16d4d6-0f27-4c4c-bd5c-f190730ea97d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc" status: 200 len: 1365 microversion: 2.1 time: 0.288718 Jun 03 10:00:08.627413 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 206/377] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:08 2022] GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc => generated 1365 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:08.657544 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-249bb9de-c63e-4dca-96ab-82e587c1f0e6 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:08.659171 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-3dc36558-744f-4f61-a47c-e33c86e95b7b tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1999845773", "imageRef": "0cb3b007-4e95-448b-8acb-895d8acdb244", "flavorRef": "452"}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:00:08.669777 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-249bb9de-c63e-4dca-96ab-82e587c1f0e6 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6" status: 200 len: 1564 microversion: 2.1 time: 0.317327 Jun 03 10:00:08.683767 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 172/378] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:08 2022] GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 => generated 1564 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:00:08.692074 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-4381da04-9852-40d1-977e-7d539a3e4ebe tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:08.692937 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-4381da04-9852-40d1-977e-7d539a3e4ebe tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:08.699648 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4381da04-9852-40d1-977e-7d539a3e4ebe tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:08.700341 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4381da04-9852-40d1-977e-7d539a3e4ebe tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:08.701302 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4381da04-9852-40d1-977e-7d539a3e4ebe tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:08.701991 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4381da04-9852-40d1-977e-7d539a3e4ebe tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:08.735654 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.network.neutron [None req-3dc36558-744f-4f61-a47c-e33c86e95b7b tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] validate_networks() for None {{(pid=117647) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 10:00:08.858517 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-4381da04-9852-40d1-977e-7d539a3e4ebe tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.172780 Jun 03 10:00:08.859103 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 173/379] 10.222.0.45 () {58 vars in 1274 bytes} [Fri Jun 3 10:00:08 2022] GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6/os-interface => generated 284 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:00:09.188678 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-3dc36558-744f-4f61-a47c-e33c86e95b7b tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Flavor limits 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 10:00:09.189144 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-3dc36558-744f-4f61-a47c-e33c86e95b7b tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Image limits 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 10:00:09.189586 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-3dc36558-744f-4f61-a47c-e33c86e95b7b tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Flavor pref 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 10:00:09.190384 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-3dc36558-744f-4f61-a47c-e33c86e95b7b tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Image pref 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 10:00:09.190800 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-3dc36558-744f-4f61-a47c-e33c86e95b7b tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 10:00:09.194211 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 10:00:09.194938 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Fri Jun 3 10:00:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 10:00:09.206184 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3dc36558-744f-4f61-a47c-e33c86e95b7b tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:09.206953 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3dc36558-744f-4f61-a47c-e33c86e95b7b tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:09.208836 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3dc36558-744f-4f61-a47c-e33c86e95b7b tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:09.209306 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3dc36558-744f-4f61-a47c-e33c86e95b7b tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:09.233761 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-3dc36558-744f-4f61-a47c-e33c86e95b7b tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Getting quotas for project aa11acd38ae14aeea91a05c97b166960. Resources: {'ram', 'cores', 'instances'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 10:00:09.241415 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-3dc36558-744f-4f61-a47c-e33c86e95b7b tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Getting quotas for user 5cf34288d4ee46bcb04347985ebf2fa7 and project aa11acd38ae14aeea91a05c97b166960. Resources: {'ram', 'cores', 'instances'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 10:00:09.249367 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-2238ca2d-8731-4cde-9f91-8fad235cfcc1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:09.251729 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-2238ca2d-8731-4cde-9f91-8fad235cfcc1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:09.264992 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2238ca2d-8731-4cde-9f91-8fad235cfcc1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:09.265726 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2238ca2d-8731-4cde-9f91-8fad235cfcc1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:09.267407 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2238ca2d-8731-4cde-9f91-8fad235cfcc1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:09.268463 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2238ca2d-8731-4cde-9f91-8fad235cfcc1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:09.276893 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-3dc36558-744f-4f61-a47c-e33c86e95b7b tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Going to run 1 instances... {{(pid=117647) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 10:00:09.280846 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-3dc36558-744f-4f61-a47c-e33c86e95b7b tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] [instance: 99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0cb3b007-4e95-448b-8acb-895d8acdb244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 10:00:09.295786 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:00:09.337879 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-3dc36558-744f-4f61-a47c-e33c86e95b7b tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.682768 Jun 03 10:00:09.338881 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 207/380] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jun 3 10:00:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 685 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 03 10:00:09.348570 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-b2409d79-1df6-478e-a3ac-227467d821f7 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:09.349203 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-b2409d79-1df6-478e-a3ac-227467d821f7 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: ac4d607d-8ff8-4931-b17d-460fda9c0917] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:09.357547 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b2409d79-1df6-478e-a3ac-227467d821f7 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:09.357971 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b2409d79-1df6-478e-a3ac-227467d821f7 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:09.358830 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b2409d79-1df6-478e-a3ac-227467d821f7 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:09.359275 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b2409d79-1df6-478e-a3ac-227467d821f7 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:09.609677 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-2238ca2d-8731-4cde-9f91-8fad235cfcc1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:09.619236 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-2238ca2d-8731-4cde-9f91-8fad235cfcc1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:09.622122 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-2238ca2d-8731-4cde-9f91-8fad235cfcc1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:09.623852 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-2238ca2d-8731-4cde-9f91-8fad235cfcc1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1723 microversion: 2.20 time: 0.383165 Jun 03 10:00:09.624588 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 174/381] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:09 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1723 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:09.633992 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-fbfb4d06-2258-4147-ab6c-87059389e5e1 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:09.634869 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-fbfb4d06-2258-4147-ab6c-87059389e5e1 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] [instance: 99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:09.685579 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-b2409d79-1df6-478e-a3ac-227467d821f7 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:09.714370 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-b2409d79-1df6-478e-a3ac-227467d821f7 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917" status: 200 len: 1265 microversion: 2.1 time: 0.373692 Jun 03 10:00:09.718560 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 208/382] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:09 2022] GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917 => generated 1265 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:09.728434 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-13ff9194-7107-4be0-aad8-ef932a8479b7 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:09.730456 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-13ff9194-7107-4be0-aad8-ef932a8479b7 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 2ecad1bf-3c89-4b29-a511-6e3d71a834fc] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:09.742648 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-13ff9194-7107-4be0-aad8-ef932a8479b7 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:09.744161 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-13ff9194-7107-4be0-aad8-ef932a8479b7 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:09.745410 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-13ff9194-7107-4be0-aad8-ef932a8479b7 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:09.747479 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-13ff9194-7107-4be0-aad8-ef932a8479b7 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:09.782138 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-fbfb4d06-2258-4147-ab6c-87059389e5e1 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf34288d4ee46bcb04347985ebf2fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa11acd38ae14aeea91a05c97b166960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:09.784882 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell0:SELECT=21 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:00:09.790568 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-fbfb4d06-2258-4147-ab6c-87059389e5e1 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] 10.222.0.45 "GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e" status: 200 len: 1215 microversion: 2.1 time: 0.162984 Jun 03 10:00:09.799244 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 175/383] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:09 2022] GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e => generated 1215 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:09.811983 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-40fa9bb9-8f89-4983-91db-b8d15f6c4734 req-a75f3061-d18d-4cb9-a817-b23d109573d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ecad1bf-3c89-4b29-a511-6e3d71a834fc", "tag": "9e1af8da-841e-40c5-97a6-85870409a32f"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:00:09.835793 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-40fa9bb9-8f89-4983-91db-b8d15f6c4734 req-a75f3061-d18d-4cb9-a817-b23d109573d6 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:09.836243 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-40fa9bb9-8f89-4983-91db-b8d15f6c4734 req-a75f3061-d18d-4cb9-a817-b23d109573d6 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:09.860991 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-40fa9bb9-8f89-4983-91db-b8d15f6c4734 req-a75f3061-d18d-4cb9-a817-b23d109573d6 service nova] Creating event network-changed:9e1af8da-841e-40c5-97a6-85870409a32f for instance 2ecad1bf-3c89-4b29-a511-6e3d71a834fc on hv-cinder-79760 Jun 03 10:00:09.868404 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-40fa9bb9-8f89-4983-91db-b8d15f6c4734 req-a75f3061-d18d-4cb9-a817-b23d109573d6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067745 Jun 03 10:00:09.869026 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 176/384] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:00:10.002797 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-13ff9194-7107-4be0-aad8-ef932a8479b7 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:10.013222 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-13ff9194-7107-4be0-aad8-ef932a8479b7 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc" status: 200 len: 1365 microversion: 2.1 time: 0.290422 Jun 03 10:00:10.023947 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 209/385] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:09 2022] GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc => generated 1365 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:10.028253 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-0641a73e-5fc5-4cbf-b9e9-8e3a0ec144e2 req-269291e0-c0bb-4ee3-97dd-e89ebfafaf4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd6f7d78-98ab-4e91-83cd-fae19bd9bae6", "tag": "188b0350-b3f9-4bd3-92de-c42a02aaa09f"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:00:10.040266 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-0641a73e-5fc5-4cbf-b9e9-8e3a0ec144e2 req-269291e0-c0bb-4ee3-97dd-e89ebfafaf4a service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:10.041081 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-0641a73e-5fc5-4cbf-b9e9-8e3a0ec144e2 req-269291e0-c0bb-4ee3-97dd-e89ebfafaf4a service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:10.067144 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-0641a73e-5fc5-4cbf-b9e9-8e3a0ec144e2 req-269291e0-c0bb-4ee3-97dd-e89ebfafaf4a service nova] Creating event network-changed:188b0350-b3f9-4bd3-92de-c42a02aaa09f for instance fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 on hv-cinder-79760 Jun 03 10:00:10.074087 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-0641a73e-5fc5-4cbf-b9e9-8e3a0ec144e2 req-269291e0-c0bb-4ee3-97dd-e89ebfafaf4a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049518 Jun 03 10:00:10.076294 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 177/386] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:00:10.644363 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-2bf0453a-d395-44cf-b9c6-75b124657156 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:10.644900 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-2bf0453a-d395-44cf-b9c6-75b124657156 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:10.651270 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2bf0453a-d395-44cf-b9c6-75b124657156 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:10.651715 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2bf0453a-d395-44cf-b9c6-75b124657156 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:10.652469 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2bf0453a-d395-44cf-b9c6-75b124657156 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:10.652898 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2bf0453a-d395-44cf-b9c6-75b124657156 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:10.736649 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-22469dc7-cae9-4335-8d4b-08543ab0a965 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:10.737996 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-22469dc7-cae9-4335-8d4b-08543ab0a965 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: ac4d607d-8ff8-4931-b17d-460fda9c0917] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:10.744411 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-22469dc7-cae9-4335-8d4b-08543ab0a965 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:10.744808 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-22469dc7-cae9-4335-8d4b-08543ab0a965 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:10.745579 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-22469dc7-cae9-4335-8d4b-08543ab0a965 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:10.746022 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-22469dc7-cae9-4335-8d4b-08543ab0a965 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:10.750847 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell1:SELECT=100 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:00:10.792952 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-2bf0453a-d395-44cf-b9c6-75b124657156 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:10.805538 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-2bf0453a-d395-44cf-b9c6-75b124657156 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:10.807857 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-2bf0453a-d395-44cf-b9c6-75b124657156 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:10.809168 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-2bf0453a-d395-44cf-b9c6-75b124657156 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1723 microversion: 2.20 time: 0.169254 Jun 03 10:00:10.810466 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 210/387] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:10 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:10.819134 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-08f180d6-ac6a-4091-9061-e44bbadde5a9 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:10.820615 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-08f180d6-ac6a-4091-9061-e44bbadde5a9 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] [instance: 99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:10.830501 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-08f180d6-ac6a-4091-9061-e44bbadde5a9 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:10.830949 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-08f180d6-ac6a-4091-9061-e44bbadde5a9 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:10.832028 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-08f180d6-ac6a-4091-9061-e44bbadde5a9 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:10.832466 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-08f180d6-ac6a-4091-9061-e44bbadde5a9 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:10.915645 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-08f180d6-ac6a-4091-9061-e44bbadde5a9 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf34288d4ee46bcb04347985ebf2fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa11acd38ae14aeea91a05c97b166960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:10.923969 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-08f180d6-ac6a-4091-9061-e44bbadde5a9 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] 10.222.0.45 "GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e" status: 200 len: 1219 microversion: 2.1 time: 0.111800 Jun 03 10:00:10.924793 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 211/388] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:10 2022] GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e => generated 1219 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:10.934296 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-22469dc7-cae9-4335-8d4b-08543ab0a965 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:10.942135 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-22469dc7-cae9-4335-8d4b-08543ab0a965 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917" status: 200 len: 1265 microversion: 2.1 time: 0.210607 Jun 03 10:00:10.942709 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 178/389] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:10 2022] GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917 => generated 1265 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:00:11.030443 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-e3ffc01c-7aee-4a61-9fcb-602b3e2818ea tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:11.031169 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-e3ffc01c-7aee-4a61-9fcb-602b3e2818ea tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 2ecad1bf-3c89-4b29-a511-6e3d71a834fc] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:11.038015 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e3ffc01c-7aee-4a61-9fcb-602b3e2818ea tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:11.038476 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e3ffc01c-7aee-4a61-9fcb-602b3e2818ea tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:11.039246 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e3ffc01c-7aee-4a61-9fcb-602b3e2818ea tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:11.039686 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e3ffc01c-7aee-4a61-9fcb-602b3e2818ea tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:11.177181 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-e3ffc01c-7aee-4a61-9fcb-602b3e2818ea tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:11.184663 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-e3ffc01c-7aee-4a61-9fcb-602b3e2818ea tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc" status: 200 len: 1365 microversion: 2.1 time: 0.158045 Jun 03 10:00:11.185225 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 212/390] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:11 2022] GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:11.838169 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-224b0de7-bfd1-4f5f-bcb5-0dd283ece697 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:11.838708 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-224b0de7-bfd1-4f5f-bcb5-0dd283ece697 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:11.845258 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-224b0de7-bfd1-4f5f-bcb5-0dd283ece697 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:11.845710 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-224b0de7-bfd1-4f5f-bcb5-0dd283ece697 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:11.846499 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-224b0de7-bfd1-4f5f-bcb5-0dd283ece697 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:11.846939 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-224b0de7-bfd1-4f5f-bcb5-0dd283ece697 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:11.940662 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-8b8933e9-7d26-4a6d-acb4-7936afc5f00a tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:11.941281 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-8b8933e9-7d26-4a6d-acb4-7936afc5f00a tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] [instance: 99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:11.947778 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8b8933e9-7d26-4a6d-acb4-7936afc5f00a tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:11.948227 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8b8933e9-7d26-4a6d-acb4-7936afc5f00a tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:11.948999 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8b8933e9-7d26-4a6d-acb4-7936afc5f00a tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:11.949440 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8b8933e9-7d26-4a6d-acb4-7936afc5f00a tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:11.975355 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-224b0de7-bfd1-4f5f-bcb5-0dd283ece697 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:11.983460 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-224b0de7-bfd1-4f5f-bcb5-0dd283ece697 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:11.985072 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-224b0de7-bfd1-4f5f-bcb5-0dd283ece697 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:11.986377 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-224b0de7-bfd1-4f5f-bcb5-0dd283ece697 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1723 microversion: 2.20 time: 0.152266 Jun 03 10:00:11.987063 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 179/391] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:11 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:11.997143 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-a1f0cb06-51ed-429f-88d4-131606989ac2 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:11.997143 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-a1f0cb06-51ed-429f-88d4-131606989ac2 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: ac4d607d-8ff8-4931-b17d-460fda9c0917] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:11.998852 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a1f0cb06-51ed-429f-88d4-131606989ac2 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:11.999363 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a1f0cb06-51ed-429f-88d4-131606989ac2 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:12.000690 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a1f0cb06-51ed-429f-88d4-131606989ac2 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:12.001185 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a1f0cb06-51ed-429f-88d4-131606989ac2 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:12.009841 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-8b8933e9-7d26-4a6d-acb4-7936afc5f00a tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf34288d4ee46bcb04347985ebf2fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa11acd38ae14aeea91a05c97b166960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:12.018098 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-8b8933e9-7d26-4a6d-acb4-7936afc5f00a tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] 10.222.0.45 "GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e" status: 200 len: 1219 microversion: 2.1 time: 0.081602 Jun 03 10:00:12.018669 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 213/392] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:11 2022] GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:00:12.131611 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-a1f0cb06-51ed-429f-88d4-131606989ac2 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:12.139703 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-a1f0cb06-51ed-429f-88d4-131606989ac2 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917" status: 200 len: 1265 microversion: 2.1 time: 0.151474 Jun 03 10:00:12.140393 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 180/393] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:11 2022] GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:12.200108 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-4cf98a32-27fe-4ce7-9366-a84922c606b8 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:12.200780 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-4cf98a32-27fe-4ce7-9366-a84922c606b8 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 2ecad1bf-3c89-4b29-a511-6e3d71a834fc] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:12.206815 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4cf98a32-27fe-4ce7-9366-a84922c606b8 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:12.207259 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4cf98a32-27fe-4ce7-9366-a84922c606b8 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:12.208016 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4cf98a32-27fe-4ce7-9366-a84922c606b8 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:12.208451 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4cf98a32-27fe-4ce7-9366-a84922c606b8 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:12.335383 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-4cf98a32-27fe-4ce7-9366-a84922c606b8 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:12.342856 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-4cf98a32-27fe-4ce7-9366-a84922c606b8 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc" status: 200 len: 1365 microversion: 2.1 time: 0.146498 Jun 03 10:00:12.343423 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 214/394] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:12 2022] GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:13.004380 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-1eb083a4-0086-4891-a855-5af2bf521686 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:13.004981 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-1eb083a4-0086-4891-a855-5af2bf521686 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:13.011018 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1eb083a4-0086-4891-a855-5af2bf521686 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:13.011462 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1eb083a4-0086-4891-a855-5af2bf521686 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:13.012211 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1eb083a4-0086-4891-a855-5af2bf521686 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:13.012643 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1eb083a4-0086-4891-a855-5af2bf521686 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:13.035679 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-ab21b2e7-8115-4c9d-95ab-fcbf50ac5b1f tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:13.036298 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-ab21b2e7-8115-4c9d-95ab-fcbf50ac5b1f tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] [instance: 99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:13.042804 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ab21b2e7-8115-4c9d-95ab-fcbf50ac5b1f tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:13.043256 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ab21b2e7-8115-4c9d-95ab-fcbf50ac5b1f tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:13.044030 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ab21b2e7-8115-4c9d-95ab-fcbf50ac5b1f tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:13.044472 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ab21b2e7-8115-4c9d-95ab-fcbf50ac5b1f tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:13.119672 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-ab21b2e7-8115-4c9d-95ab-fcbf50ac5b1f tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf34288d4ee46bcb04347985ebf2fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa11acd38ae14aeea91a05c97b166960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:13.127343 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-ab21b2e7-8115-4c9d-95ab-fcbf50ac5b1f tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] 10.222.0.45 "GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e" status: 200 len: 1219 microversion: 2.1 time: 0.096238 Jun 03 10:00:13.128202 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 215/395] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:13 2022] GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:00:13.157374 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-71f6dec9-1488-4833-950b-3ceab1a16761 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:13.158595 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-71f6dec9-1488-4833-950b-3ceab1a16761 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: ac4d607d-8ff8-4931-b17d-460fda9c0917] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:13.164651 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-71f6dec9-1488-4833-950b-3ceab1a16761 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:13.165095 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-71f6dec9-1488-4833-950b-3ceab1a16761 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:13.165907 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-71f6dec9-1488-4833-950b-3ceab1a16761 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:13.166546 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-71f6dec9-1488-4833-950b-3ceab1a16761 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:13.179072 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-1eb083a4-0086-4891-a855-5af2bf521686 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:13.187081 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-1eb083a4-0086-4891-a855-5af2bf521686 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:13.188621 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-1eb083a4-0086-4891-a855-5af2bf521686 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:13.189856 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-1eb083a4-0086-4891-a855-5af2bf521686 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1723 microversion: 2.20 time: 0.189389 Jun 03 10:00:13.190410 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 181/396] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:12 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:13.295789 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-71f6dec9-1488-4833-950b-3ceab1a16761 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:13.303535 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-71f6dec9-1488-4833-950b-3ceab1a16761 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917" status: 200 len: 1265 microversion: 2.1 time: 0.150823 Jun 03 10:00:13.304105 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 216/397] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:13 2022] GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:00:13.359321 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-d8752b14-6bd9-4550-874c-46497dd71df9 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:13.359933 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-d8752b14-6bd9-4550-874c-46497dd71df9 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 2ecad1bf-3c89-4b29-a511-6e3d71a834fc] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:13.365987 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d8752b14-6bd9-4550-874c-46497dd71df9 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:13.366377 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d8752b14-6bd9-4550-874c-46497dd71df9 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:13.367161 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d8752b14-6bd9-4550-874c-46497dd71df9 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:13.367591 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d8752b14-6bd9-4550-874c-46497dd71df9 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:13.493202 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d8752b14-6bd9-4550-874c-46497dd71df9 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:13.500617 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-d8752b14-6bd9-4550-874c-46497dd71df9 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc" status: 200 len: 1365 microversion: 2.1 time: 0.145021 Jun 03 10:00:13.501171 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 182/398] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:13 2022] GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc => generated 1365 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:14.144718 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-a2fd1859-6883-4ef9-885e-9a109fc2ae0e tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:14.145324 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-a2fd1859-6883-4ef9-885e-9a109fc2ae0e tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] [instance: 99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:14.151797 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a2fd1859-6883-4ef9-885e-9a109fc2ae0e tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:14.152241 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a2fd1859-6883-4ef9-885e-9a109fc2ae0e tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:14.152993 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a2fd1859-6883-4ef9-885e-9a109fc2ae0e tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:14.153422 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a2fd1859-6883-4ef9-885e-9a109fc2ae0e tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:14.208500 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-98d8b12a-1547-40cb-a3d0-6d97d1181fe2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:14.209101 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-98d8b12a-1547-40cb-a3d0-6d97d1181fe2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:14.210953 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell0:SELECT=6 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:00:14.212178 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:00:14.217370 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-a2fd1859-6883-4ef9-885e-9a109fc2ae0e tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf34288d4ee46bcb04347985ebf2fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa11acd38ae14aeea91a05c97b166960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:14.218448 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-98d8b12a-1547-40cb-a3d0-6d97d1181fe2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:14.218992 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-98d8b12a-1547-40cb-a3d0-6d97d1181fe2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:14.219757 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-98d8b12a-1547-40cb-a3d0-6d97d1181fe2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:14.220182 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-98d8b12a-1547-40cb-a3d0-6d97d1181fe2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:14.224796 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-a2fd1859-6883-4ef9-885e-9a109fc2ae0e tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] 10.222.0.45 "GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e" status: 200 len: 1219 microversion: 2.1 time: 0.084427 Jun 03 10:00:14.225681 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 217/399] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:14 2022] GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:14.320517 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-7b96776e-b4f8-4f81-92fe-182392fa90cd tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:14.321247 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-7b96776e-b4f8-4f81-92fe-182392fa90cd tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: ac4d607d-8ff8-4931-b17d-460fda9c0917] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:14.327432 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7b96776e-b4f8-4f81-92fe-182392fa90cd tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:14.327960 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7b96776e-b4f8-4f81-92fe-182392fa90cd tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:14.329355 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7b96776e-b4f8-4f81-92fe-182392fa90cd tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:14.329818 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7b96776e-b4f8-4f81-92fe-182392fa90cd tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:14.344220 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=100 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:00:14.348622 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-98d8b12a-1547-40cb-a3d0-6d97d1181fe2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:14.356556 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-98d8b12a-1547-40cb-a3d0-6d97d1181fe2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:14.358106 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-98d8b12a-1547-40cb-a3d0-6d97d1181fe2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:14.359264 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-98d8b12a-1547-40cb-a3d0-6d97d1181fe2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1723 microversion: 2.20 time: 0.154826 Jun 03 10:00:14.359820 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 183/400] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:14 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 10:00:14.462338 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-7b96776e-b4f8-4f81-92fe-182392fa90cd tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:14.470050 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-7b96776e-b4f8-4f81-92fe-182392fa90cd tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917" status: 200 len: 1265 microversion: 2.1 time: 0.153519 Jun 03 10:00:14.470615 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 218/401] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:14 2022] GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:00:14.516172 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-89209c50-681d-4f6f-840a-756d343c0657 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:14.516788 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-89209c50-681d-4f6f-840a-756d343c0657 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 2ecad1bf-3c89-4b29-a511-6e3d71a834fc] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:14.522839 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-89209c50-681d-4f6f-840a-756d343c0657 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:14.523290 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-89209c50-681d-4f6f-840a-756d343c0657 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:14.524047 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-89209c50-681d-4f6f-840a-756d343c0657 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:14.524482 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-89209c50-681d-4f6f-840a-756d343c0657 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:14.651915 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-89209c50-681d-4f6f-840a-756d343c0657 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:14.659527 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-89209c50-681d-4f6f-840a-756d343c0657 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc" status: 200 len: 1365 microversion: 2.1 time: 0.147175 Jun 03 10:00:14.660076 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 184/402] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:14 2022] GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc => generated 1365 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:15.241914 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-b923cf45-fd64-43da-b99a-5ff4604e69b3 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:15.242668 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-b923cf45-fd64-43da-b99a-5ff4604e69b3 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] [instance: 99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:15.249825 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b923cf45-fd64-43da-b99a-5ff4604e69b3 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:15.250281 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b923cf45-fd64-43da-b99a-5ff4604e69b3 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:15.251045 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b923cf45-fd64-43da-b99a-5ff4604e69b3 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:15.251484 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b923cf45-fd64-43da-b99a-5ff4604e69b3 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:15.311179 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-b923cf45-fd64-43da-b99a-5ff4604e69b3 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf34288d4ee46bcb04347985ebf2fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa11acd38ae14aeea91a05c97b166960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:15.318598 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-b923cf45-fd64-43da-b99a-5ff4604e69b3 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] 10.222.0.45 "GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e" status: 200 len: 1219 microversion: 2.1 time: 0.080770 Jun 03 10:00:15.319154 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 219/403] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:15 2022] GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:15.377171 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-f7e3ac6c-5e24-4ce1-a3e1-49275e261296 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:15.377804 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-f7e3ac6c-5e24-4ce1-a3e1-49275e261296 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:15.384426 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f7e3ac6c-5e24-4ce1-a3e1-49275e261296 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:15.384881 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f7e3ac6c-5e24-4ce1-a3e1-49275e261296 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:15.385647 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f7e3ac6c-5e24-4ce1-a3e1-49275e261296 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:15.386108 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f7e3ac6c-5e24-4ce1-a3e1-49275e261296 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:15.486197 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-1709b54d-9640-4ca7-9ac4-1076efe2259f tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:15.486836 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-1709b54d-9640-4ca7-9ac4-1076efe2259f tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: ac4d607d-8ff8-4931-b17d-460fda9c0917] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:15.492748 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1709b54d-9640-4ca7-9ac4-1076efe2259f tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:15.493188 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1709b54d-9640-4ca7-9ac4-1076efe2259f tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:15.493973 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1709b54d-9640-4ca7-9ac4-1076efe2259f tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:15.494405 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1709b54d-9640-4ca7-9ac4-1076efe2259f tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:15.517501 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f7e3ac6c-5e24-4ce1-a3e1-49275e261296 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:15.525387 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f7e3ac6c-5e24-4ce1-a3e1-49275e261296 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:15.526931 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f7e3ac6c-5e24-4ce1-a3e1-49275e261296 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:15.528082 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-f7e3ac6c-5e24-4ce1-a3e1-49275e261296 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1723 microversion: 2.20 time: 0.154778 Jun 03 10:00:15.528638 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 185/404] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:15 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:15.620745 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-1709b54d-9640-4ca7-9ac4-1076efe2259f tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:15.628677 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-1709b54d-9640-4ca7-9ac4-1076efe2259f tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917" status: 200 len: 1265 microversion: 2.1 time: 0.146303 Jun 03 10:00:15.629236 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 220/405] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:15 2022] GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917 => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:00:15.675866 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-d82423b6-fca0-4c45-8d6b-302bbcc320aa tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:15.676488 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-d82423b6-fca0-4c45-8d6b-302bbcc320aa tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 2ecad1bf-3c89-4b29-a511-6e3d71a834fc] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:15.682458 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d82423b6-fca0-4c45-8d6b-302bbcc320aa tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:15.682907 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d82423b6-fca0-4c45-8d6b-302bbcc320aa tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:15.683670 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d82423b6-fca0-4c45-8d6b-302bbcc320aa tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:15.684108 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d82423b6-fca0-4c45-8d6b-302bbcc320aa tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:15.817444 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d82423b6-fca0-4c45-8d6b-302bbcc320aa tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:15.824701 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-d82423b6-fca0-4c45-8d6b-302bbcc320aa tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc" status: 200 len: 1365 microversion: 2.1 time: 0.152624 Jun 03 10:00:15.825257 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 186/406] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:15 2022] GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:16.335161 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-1969321c-57bd-49cc-a567-eb18c3506ee0 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:16.335780 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-1969321c-57bd-49cc-a567-eb18c3506ee0 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] [instance: 99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:16.342326 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1969321c-57bd-49cc-a567-eb18c3506ee0 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:16.342777 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1969321c-57bd-49cc-a567-eb18c3506ee0 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:16.343546 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1969321c-57bd-49cc-a567-eb18c3506ee0 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:16.344476 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1969321c-57bd-49cc-a567-eb18c3506ee0 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:16.408904 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-1969321c-57bd-49cc-a567-eb18c3506ee0 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf34288d4ee46bcb04347985ebf2fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa11acd38ae14aeea91a05c97b166960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:16.416495 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-1969321c-57bd-49cc-a567-eb18c3506ee0 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] 10.222.0.45 "GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e" status: 200 len: 1219 microversion: 2.1 time: 0.085111 Jun 03 10:00:16.417055 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 221/407] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:16 2022] GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:16.546846 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-2fc497ea-7634-4c32-ad14-9b3a03bfd166 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:16.548045 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-2fc497ea-7634-4c32-ad14-9b3a03bfd166 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:16.554541 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2fc497ea-7634-4c32-ad14-9b3a03bfd166 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:16.554989 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2fc497ea-7634-4c32-ad14-9b3a03bfd166 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:16.555749 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2fc497ea-7634-4c32-ad14-9b3a03bfd166 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:16.556190 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2fc497ea-7634-4c32-ad14-9b3a03bfd166 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:16.645476 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-5c25bf12-1fd2-4b7b-9277-15c875faa0ee tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:16.646050 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-5c25bf12-1fd2-4b7b-9277-15c875faa0ee tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: ac4d607d-8ff8-4931-b17d-460fda9c0917] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:16.652040 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5c25bf12-1fd2-4b7b-9277-15c875faa0ee tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:16.652490 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5c25bf12-1fd2-4b7b-9277-15c875faa0ee tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:16.653257 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5c25bf12-1fd2-4b7b-9277-15c875faa0ee tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:16.653694 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5c25bf12-1fd2-4b7b-9277-15c875faa0ee tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:16.683641 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-2fc497ea-7634-4c32-ad14-9b3a03bfd166 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:16.691708 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-2fc497ea-7634-4c32-ad14-9b3a03bfd166 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:16.693218 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-2fc497ea-7634-4c32-ad14-9b3a03bfd166 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:16.694441 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-2fc497ea-7634-4c32-ad14-9b3a03bfd166 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1723 microversion: 2.20 time: 0.151433 Jun 03 10:00:16.695006 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 187/408] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:16 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:16.780733 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-5c25bf12-1fd2-4b7b-9277-15c875faa0ee tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:16.789121 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-5c25bf12-1fd2-4b7b-9277-15c875faa0ee tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917" status: 200 len: 1265 microversion: 2.1 time: 0.147448 Jun 03 10:00:16.789693 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 222/409] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:16 2022] GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:16.841740 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-67774c3c-3f8f-47ff-b54c-6b6f3968bf2f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:16.842377 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-67774c3c-3f8f-47ff-b54c-6b6f3968bf2f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 2ecad1bf-3c89-4b29-a511-6e3d71a834fc] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:16.848968 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-67774c3c-3f8f-47ff-b54c-6b6f3968bf2f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:16.849409 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-67774c3c-3f8f-47ff-b54c-6b6f3968bf2f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:16.850197 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-67774c3c-3f8f-47ff-b54c-6b6f3968bf2f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:16.850637 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-67774c3c-3f8f-47ff-b54c-6b6f3968bf2f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:16.976430 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-67774c3c-3f8f-47ff-b54c-6b6f3968bf2f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:16.983728 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-67774c3c-3f8f-47ff-b54c-6b6f3968bf2f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc" status: 200 len: 1365 microversion: 2.1 time: 0.145752 Jun 03 10:00:16.984293 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 188/410] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:16 2022] GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc => generated 1365 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:17.433963 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-0ab2e49f-d1e2-4c9f-90b3-5a12b3a9a66f tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:17.434579 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-0ab2e49f-d1e2-4c9f-90b3-5a12b3a9a66f tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] [instance: 99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:17.441573 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0ab2e49f-d1e2-4c9f-90b3-5a12b3a9a66f tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:17.442056 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0ab2e49f-d1e2-4c9f-90b3-5a12b3a9a66f tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:17.442815 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0ab2e49f-d1e2-4c9f-90b3-5a12b3a9a66f tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:17.443254 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0ab2e49f-d1e2-4c9f-90b3-5a12b3a9a66f tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:17.509245 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-0ab2e49f-d1e2-4c9f-90b3-5a12b3a9a66f tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf34288d4ee46bcb04347985ebf2fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa11acd38ae14aeea91a05c97b166960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:17.516751 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-0ab2e49f-d1e2-4c9f-90b3-5a12b3a9a66f tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] 10.222.0.45 "GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e" status: 200 len: 1219 microversion: 2.1 time: 0.086653 Jun 03 10:00:17.517249 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 223/411] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:17 2022] GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:17.712875 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-98b9c7b5-9c56-41b6-bb19-e599ff9bd1d2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:17.713476 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-98b9c7b5-9c56-41b6-bb19-e599ff9bd1d2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:17.719915 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-98b9c7b5-9c56-41b6-bb19-e599ff9bd1d2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:17.720356 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-98b9c7b5-9c56-41b6-bb19-e599ff9bd1d2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:17.721103 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-98b9c7b5-9c56-41b6-bb19-e599ff9bd1d2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:17.721530 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-98b9c7b5-9c56-41b6-bb19-e599ff9bd1d2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:17.805012 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-2b45d904-6212-43e3-8a55-4381cde16835 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:17.805633 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-2b45d904-6212-43e3-8a55-4381cde16835 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: ac4d607d-8ff8-4931-b17d-460fda9c0917] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:17.811723 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2b45d904-6212-43e3-8a55-4381cde16835 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:17.812171 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2b45d904-6212-43e3-8a55-4381cde16835 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:17.812938 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2b45d904-6212-43e3-8a55-4381cde16835 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:17.813383 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2b45d904-6212-43e3-8a55-4381cde16835 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:17.849430 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-98b9c7b5-9c56-41b6-bb19-e599ff9bd1d2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:17.859097 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-98b9c7b5-9c56-41b6-bb19-e599ff9bd1d2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:17.861294 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-98b9c7b5-9c56-41b6-bb19-e599ff9bd1d2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:17.862500 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-98b9c7b5-9c56-41b6-bb19-e599ff9bd1d2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1723 microversion: 2.20 time: 0.153416 Jun 03 10:00:17.863065 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 189/412] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:17 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:17.949663 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-2b45d904-6212-43e3-8a55-4381cde16835 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:17.957036 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-2b45d904-6212-43e3-8a55-4381cde16835 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917" status: 200 len: 1265 microversion: 2.1 time: 0.155975 Jun 03 10:00:17.957599 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 224/413] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:17 2022] GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:00:18.000280 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-eda8e64d-de20-487d-bbef-c54b3c04f3e3 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:18.000892 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-eda8e64d-de20-487d-bbef-c54b3c04f3e3 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 2ecad1bf-3c89-4b29-a511-6e3d71a834fc] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:18.006862 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-eda8e64d-de20-487d-bbef-c54b3c04f3e3 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:18.007310 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-eda8e64d-de20-487d-bbef-c54b3c04f3e3 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:18.008069 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-eda8e64d-de20-487d-bbef-c54b3c04f3e3 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:18.008501 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-eda8e64d-de20-487d-bbef-c54b3c04f3e3 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:18.144347 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-eda8e64d-de20-487d-bbef-c54b3c04f3e3 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:18.151793 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-eda8e64d-de20-487d-bbef-c54b3c04f3e3 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc" status: 200 len: 1365 microversion: 2.1 time: 0.155320 Jun 03 10:00:18.152358 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 190/414] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:17 2022] GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:18.534228 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-01bdafce-54b6-4c8c-ba42-e57673296e5a tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:18.534861 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-01bdafce-54b6-4c8c-ba42-e57673296e5a tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] [instance: 99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:18.541359 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-01bdafce-54b6-4c8c-ba42-e57673296e5a tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:18.541827 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-01bdafce-54b6-4c8c-ba42-e57673296e5a tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:18.542582 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-01bdafce-54b6-4c8c-ba42-e57673296e5a tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:18.543014 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-01bdafce-54b6-4c8c-ba42-e57673296e5a tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:18.605516 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-01bdafce-54b6-4c8c-ba42-e57673296e5a tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf34288d4ee46bcb04347985ebf2fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa11acd38ae14aeea91a05c97b166960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:18.612892 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-01bdafce-54b6-4c8c-ba42-e57673296e5a tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] 10.222.0.45 "GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e" status: 200 len: 1219 microversion: 2.1 time: 0.083295 Jun 03 10:00:18.613448 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 225/415] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:18 2022] GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:18.880968 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-fe6bf8cc-ddaf-49cb-97ce-0f0bb61b91eb tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:18.881580 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-fe6bf8cc-ddaf-49cb-97ce-0f0bb61b91eb tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:18.888172 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fe6bf8cc-ddaf-49cb-97ce-0f0bb61b91eb tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:18.888626 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fe6bf8cc-ddaf-49cb-97ce-0f0bb61b91eb tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:18.889410 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fe6bf8cc-ddaf-49cb-97ce-0f0bb61b91eb tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:18.889864 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fe6bf8cc-ddaf-49cb-97ce-0f0bb61b91eb tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:18.973420 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-ec67f63e-bbc3-4d56-a956-0caaee7c35a0 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:18.974079 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-ec67f63e-bbc3-4d56-a956-0caaee7c35a0 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: ac4d607d-8ff8-4931-b17d-460fda9c0917] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:18.980100 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ec67f63e-bbc3-4d56-a956-0caaee7c35a0 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:18.980544 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ec67f63e-bbc3-4d56-a956-0caaee7c35a0 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:18.981304 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ec67f63e-bbc3-4d56-a956-0caaee7c35a0 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:18.981736 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ec67f63e-bbc3-4d56-a956-0caaee7c35a0 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:19.017826 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-fe6bf8cc-ddaf-49cb-97ce-0f0bb61b91eb tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:19.025925 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-fe6bf8cc-ddaf-49cb-97ce-0f0bb61b91eb tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:19.027590 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-fe6bf8cc-ddaf-49cb-97ce-0f0bb61b91eb tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:19.028832 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-fe6bf8cc-ddaf-49cb-97ce-0f0bb61b91eb tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1723 microversion: 2.20 time: 0.151743 Jun 03 10:00:19.029475 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 191/416] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:18 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:19.113461 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-ec67f63e-bbc3-4d56-a956-0caaee7c35a0 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:19.122875 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-ec67f63e-bbc3-4d56-a956-0caaee7c35a0 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917" status: 200 len: 1265 microversion: 2.1 time: 0.153160 Jun 03 10:00:19.123433 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 226/417] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:18 2022] GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:00:19.178509 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-e0551c36-5665-4bfe-a41d-0e48019a1ec0 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:19.179274 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-e0551c36-5665-4bfe-a41d-0e48019a1ec0 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 2ecad1bf-3c89-4b29-a511-6e3d71a834fc] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:19.186503 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e0551c36-5665-4bfe-a41d-0e48019a1ec0 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:19.186954 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e0551c36-5665-4bfe-a41d-0e48019a1ec0 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:19.187751 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e0551c36-5665-4bfe-a41d-0e48019a1ec0 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:19.188190 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e0551c36-5665-4bfe-a41d-0e48019a1ec0 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:19.317500 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-e0551c36-5665-4bfe-a41d-0e48019a1ec0 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:19.324875 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-e0551c36-5665-4bfe-a41d-0e48019a1ec0 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc" status: 200 len: 1365 microversion: 2.1 time: 0.151145 Jun 03 10:00:19.325433 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 192/418] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:19 2022] GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:19.630487 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-68124047-8548-459e-89e5-566ee76b82fd tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:19.631100 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-68124047-8548-459e-89e5-566ee76b82fd tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] [instance: 99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:19.633147 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell0:SELECT=2 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:00:19.633886 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell0:SELECT=11 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:00:19.640132 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-68124047-8548-459e-89e5-566ee76b82fd tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:19.640590 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-68124047-8548-459e-89e5-566ee76b82fd tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:19.642319 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-68124047-8548-459e-89e5-566ee76b82fd tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:19.642756 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-68124047-8548-459e-89e5-566ee76b82fd tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:19.702630 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-68124047-8548-459e-89e5-566ee76b82fd tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf34288d4ee46bcb04347985ebf2fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa11acd38ae14aeea91a05c97b166960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:19.709919 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-68124047-8548-459e-89e5-566ee76b82fd tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] 10.222.0.45 "GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e" status: 200 len: 1219 microversion: 2.1 time: 0.083227 Jun 03 10:00:19.710480 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 227/419] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:19 2022] GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:20.048397 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-a98c61ab-3491-4690-858b-16959d51831a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:20.049032 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-a98c61ab-3491-4690-858b-16959d51831a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:20.050913 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell0:SELECT=1 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:00:20.056487 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a98c61ab-3491-4690-858b-16959d51831a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:20.056933 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a98c61ab-3491-4690-858b-16959d51831a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:20.057692 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a98c61ab-3491-4690-858b-16959d51831a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:20.058151 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a98c61ab-3491-4690-858b-16959d51831a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:20.138692 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-b9d47412-7009-4bb8-b4bb-a00a12c18eff tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:20.139348 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-b9d47412-7009-4bb8-b4bb-a00a12c18eff tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: ac4d607d-8ff8-4931-b17d-460fda9c0917] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:20.145544 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b9d47412-7009-4bb8-b4bb-a00a12c18eff tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:20.146030 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b9d47412-7009-4bb8-b4bb-a00a12c18eff tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:20.146799 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b9d47412-7009-4bb8-b4bb-a00a12c18eff tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:20.147243 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b9d47412-7009-4bb8-b4bb-a00a12c18eff tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:20.201614 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-a98c61ab-3491-4690-858b-16959d51831a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:20.209962 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-a98c61ab-3491-4690-858b-16959d51831a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:20.211553 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-a98c61ab-3491-4690-858b-16959d51831a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:20.212797 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-a98c61ab-3491-4690-858b-16959d51831a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1723 microversion: 2.20 time: 0.168831 Jun 03 10:00:20.213443 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 193/420] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:20 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:20.342377 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-9a8e59bb-a683-465b-8acc-f1ed78a275a8 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:20.342994 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-9a8e59bb-a683-465b-8acc-f1ed78a275a8 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 2ecad1bf-3c89-4b29-a511-6e3d71a834fc] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:20.350225 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9a8e59bb-a683-465b-8acc-f1ed78a275a8 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:20.350672 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9a8e59bb-a683-465b-8acc-f1ed78a275a8 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:20.351449 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9a8e59bb-a683-465b-8acc-f1ed78a275a8 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:20.351885 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9a8e59bb-a683-465b-8acc-f1ed78a275a8 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:20.554161 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-b9d47412-7009-4bb8-b4bb-a00a12c18eff tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:20.558191 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-9a8e59bb-a683-465b-8acc-f1ed78a275a8 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:20.560432 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell1:SELECT=100 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:00:20.561933 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-b9d47412-7009-4bb8-b4bb-a00a12c18eff tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917" status: 200 len: 1265 microversion: 2.1 time: 0.426841 Jun 03 10:00:20.562307 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 228/421] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:20 2022] GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917 => generated 1265 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:00:20.566925 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-9a8e59bb-a683-465b-8acc-f1ed78a275a8 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc" status: 200 len: 1365 microversion: 2.1 time: 0.228416 Jun 03 10:00:20.567645 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 194/422] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:20 2022] GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc => generated 1365 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:00:20.726573 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-0c5edc0b-9c4d-48f8-b1e1-463c0b321971 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:20.727191 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-0c5edc0b-9c4d-48f8-b1e1-463c0b321971 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] [instance: 99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:20.734109 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0c5edc0b-9c4d-48f8-b1e1-463c0b321971 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:20.734599 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0c5edc0b-9c4d-48f8-b1e1-463c0b321971 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:20.735371 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0c5edc0b-9c4d-48f8-b1e1-463c0b321971 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:20.735805 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0c5edc0b-9c4d-48f8-b1e1-463c0b321971 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:20.800931 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-0c5edc0b-9c4d-48f8-b1e1-463c0b321971 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf34288d4ee46bcb04347985ebf2fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa11acd38ae14aeea91a05c97b166960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:20.808271 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-0c5edc0b-9c4d-48f8-b1e1-463c0b321971 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] 10.222.0.45 "GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e" status: 200 len: 1219 microversion: 2.1 time: 0.085685 Jun 03 10:00:20.808825 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 229/423] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:20 2022] GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:21.231947 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-0561c369-8993-4b57-8671-cd4e516d18c1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:21.232550 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-0561c369-8993-4b57-8671-cd4e516d18c1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:21.239541 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0561c369-8993-4b57-8671-cd4e516d18c1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:21.239994 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0561c369-8993-4b57-8671-cd4e516d18c1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:21.240795 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0561c369-8993-4b57-8671-cd4e516d18c1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:21.241292 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0561c369-8993-4b57-8671-cd4e516d18c1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:21.369200 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-0561c369-8993-4b57-8671-cd4e516d18c1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:21.378045 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-0561c369-8993-4b57-8671-cd4e516d18c1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:21.379512 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-0561c369-8993-4b57-8671-cd4e516d18c1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:21.380685 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-0561c369-8993-4b57-8671-cd4e516d18c1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1723 microversion: 2.20 time: 0.152865 Jun 03 10:00:21.381254 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 195/424] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:21 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:21.579403 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-d2ea8463-cf26-4df1-9f83-92abd2af515e tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:21.579943 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-d2ea8463-cf26-4df1-9f83-92abd2af515e tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: ac4d607d-8ff8-4931-b17d-460fda9c0917] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:21.583822 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-a4059b87-5087-4369-bf4f-ad3530be995f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:21.584437 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-a4059b87-5087-4369-bf4f-ad3530be995f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 2ecad1bf-3c89-4b29-a511-6e3d71a834fc] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:21.586094 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d2ea8463-cf26-4df1-9f83-92abd2af515e tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:21.586538 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d2ea8463-cf26-4df1-9f83-92abd2af515e tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:21.587300 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d2ea8463-cf26-4df1-9f83-92abd2af515e tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:21.587733 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d2ea8463-cf26-4df1-9f83-92abd2af515e tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:21.590379 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a4059b87-5087-4369-bf4f-ad3530be995f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:21.590829 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a4059b87-5087-4369-bf4f-ad3530be995f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:21.591597 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a4059b87-5087-4369-bf4f-ad3530be995f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:21.592071 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a4059b87-5087-4369-bf4f-ad3530be995f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:21.781082 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-d2ea8463-cf26-4df1-9f83-92abd2af515e tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:21.785343 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-a4059b87-5087-4369-bf4f-ad3530be995f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:21.788828 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-d2ea8463-cf26-4df1-9f83-92abd2af515e tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917" status: 200 len: 1265 microversion: 2.1 time: 0.213837 Jun 03 10:00:21.789399 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 230/425] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:21 2022] GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917 => generated 1265 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:21.792840 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-a4059b87-5087-4369-bf4f-ad3530be995f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc" status: 200 len: 1365 microversion: 2.1 time: 0.212925 Jun 03 10:00:21.793389 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 196/426] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:21 2022] GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc => generated 1365 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:00:21.824165 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-8e73b9f5-7163-4a52-8904-d9c6b99c45f9 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:21.824778 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-8e73b9f5-7163-4a52-8904-d9c6b99c45f9 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] [instance: 99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:21.831512 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8e73b9f5-7163-4a52-8904-d9c6b99c45f9 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:21.831911 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8e73b9f5-7163-4a52-8904-d9c6b99c45f9 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:21.832674 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8e73b9f5-7163-4a52-8904-d9c6b99c45f9 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:21.833115 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8e73b9f5-7163-4a52-8904-d9c6b99c45f9 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:21.892141 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-8e73b9f5-7163-4a52-8904-d9c6b99c45f9 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf34288d4ee46bcb04347985ebf2fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa11acd38ae14aeea91a05c97b166960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:21.899466 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-8e73b9f5-7163-4a52-8904-d9c6b99c45f9 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] 10.222.0.45 "GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e" status: 200 len: 1219 microversion: 2.1 time: 0.079050 Jun 03 10:00:21.900037 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 231/427] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:21 2022] GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e => generated 1219 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:22.398669 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-317c0e71-c9e5-44b4-ae87-f0aa4c6df456 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:22.399290 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-317c0e71-c9e5-44b4-ae87-f0aa4c6df456 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:22.405906 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-317c0e71-c9e5-44b4-ae87-f0aa4c6df456 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:22.406857 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-317c0e71-c9e5-44b4-ae87-f0aa4c6df456 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:22.407632 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-317c0e71-c9e5-44b4-ae87-f0aa4c6df456 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:22.408320 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-317c0e71-c9e5-44b4-ae87-f0aa4c6df456 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:22.541350 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-317c0e71-c9e5-44b4-ae87-f0aa4c6df456 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:22.549793 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-317c0e71-c9e5-44b4-ae87-f0aa4c6df456 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:22.551296 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-317c0e71-c9e5-44b4-ae87-f0aa4c6df456 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:22.552450 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-317c0e71-c9e5-44b4-ae87-f0aa4c6df456 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1723 microversion: 2.20 time: 0.157676 Jun 03 10:00:22.553022 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 197/428] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:22 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:22.808746 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-0fc68bb1-7ec3-4a60-93b2-d00f9a495006 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:22.809295 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-0fc68bb1-7ec3-4a60-93b2-d00f9a495006 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: ac4d607d-8ff8-4931-b17d-460fda9c0917] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:22.809393 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-7aa2cfef-9e92-453b-a2ac-e9bd9e5c3018 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:22.809966 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-7aa2cfef-9e92-453b-a2ac-e9bd9e5c3018 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 2ecad1bf-3c89-4b29-a511-6e3d71a834fc] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:22.816156 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7aa2cfef-9e92-453b-a2ac-e9bd9e5c3018 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:22.816401 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0fc68bb1-7ec3-4a60-93b2-d00f9a495006 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:22.816616 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7aa2cfef-9e92-453b-a2ac-e9bd9e5c3018 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:22.816857 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0fc68bb1-7ec3-4a60-93b2-d00f9a495006 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:22.817388 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7aa2cfef-9e92-453b-a2ac-e9bd9e5c3018 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:22.817625 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0fc68bb1-7ec3-4a60-93b2-d00f9a495006 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:22.817855 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7aa2cfef-9e92-453b-a2ac-e9bd9e5c3018 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:22.818098 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0fc68bb1-7ec3-4a60-93b2-d00f9a495006 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:23.052482 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-7aa2cfef-9e92-453b-a2ac-e9bd9e5c3018 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:23.059995 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-7aa2cfef-9e92-453b-a2ac-e9bd9e5c3018 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc" status: 200 len: 1365 microversion: 2.1 time: 0.254383 Jun 03 10:00:23.060509 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 198/429] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:22 2022] GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc => generated 1365 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:00:23.060766 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-0fc68bb1-7ec3-4a60-93b2-d00f9a495006 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:23.065422 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-2b8558c2-a803-44c8-8997-8c30efc85f9c tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:23.066057 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-2b8558c2-a803-44c8-8997-8c30efc85f9c tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] [instance: 99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:23.069152 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-0fc68bb1-7ec3-4a60-93b2-d00f9a495006 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917" status: 200 len: 1265 microversion: 2.1 time: 0.264297 Jun 03 10:00:23.069820 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 232/430] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:22 2022] GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917 => generated 1265 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:23.072187 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2b8558c2-a803-44c8-8997-8c30efc85f9c tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:23.072641 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2b8558c2-a803-44c8-8997-8c30efc85f9c tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:23.073413 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2b8558c2-a803-44c8-8997-8c30efc85f9c tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:23.073972 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2b8558c2-a803-44c8-8997-8c30efc85f9c tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:23.134080 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-2b8558c2-a803-44c8-8997-8c30efc85f9c tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf34288d4ee46bcb04347985ebf2fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa11acd38ae14aeea91a05c97b166960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:23.142618 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-2b8558c2-a803-44c8-8997-8c30efc85f9c tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] 10.222.0.45 "GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e" status: 200 len: 1211 microversion: 2.1 time: 0.080842 Jun 03 10:00:23.143551 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 199/431] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:23 2022] GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e => generated 1211 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:23.570643 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-d842e68c-0596-41f5-a264-3547692737fa tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:23.571166 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-d842e68c-0596-41f5-a264-3547692737fa tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:23.577593 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d842e68c-0596-41f5-a264-3547692737fa tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:23.578092 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d842e68c-0596-41f5-a264-3547692737fa tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:23.578867 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d842e68c-0596-41f5-a264-3547692737fa tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:23.579302 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d842e68c-0596-41f5-a264-3547692737fa tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:23.707161 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-d842e68c-0596-41f5-a264-3547692737fa tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:23.715053 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-d842e68c-0596-41f5-a264-3547692737fa tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:23.716556 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-d842e68c-0596-41f5-a264-3547692737fa tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:23.717765 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-d842e68c-0596-41f5-a264-3547692737fa tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1723 microversion: 2.20 time: 0.151144 Jun 03 10:00:23.718322 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 233/432] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:23 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:24.076639 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-57b1720e-7315-40cd-b344-c4665e1226f8 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:24.077344 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-57b1720e-7315-40cd-b344-c4665e1226f8 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 2ecad1bf-3c89-4b29-a511-6e3d71a834fc] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:24.083918 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-57b1720e-7315-40cd-b344-c4665e1226f8 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:24.084366 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-57b1720e-7315-40cd-b344-c4665e1226f8 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:24.085119 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-57b1720e-7315-40cd-b344-c4665e1226f8 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:24.085550 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-57b1720e-7315-40cd-b344-c4665e1226f8 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:24.085706 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-70adc2ef-2f50-457e-8d2d-ccbe7657cf82 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:24.086348 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-70adc2ef-2f50-457e-8d2d-ccbe7657cf82 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: ac4d607d-8ff8-4931-b17d-460fda9c0917] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:24.092805 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-70adc2ef-2f50-457e-8d2d-ccbe7657cf82 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:24.093252 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-70adc2ef-2f50-457e-8d2d-ccbe7657cf82 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:24.094566 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-70adc2ef-2f50-457e-8d2d-ccbe7657cf82 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:24.095009 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-70adc2ef-2f50-457e-8d2d-ccbe7657cf82 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:24.290022 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-57b1720e-7315-40cd-b344-c4665e1226f8 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:24.298027 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-57b1720e-7315-40cd-b344-c4665e1226f8 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc" status: 200 len: 1365 microversion: 2.1 time: 0.224857 Jun 03 10:00:24.300570 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-70adc2ef-2f50-457e-8d2d-ccbe7657cf82 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:24.308844 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 200/433] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:24 2022] GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc => generated 1365 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:24.315364 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-08bf682c-f935-4095-b1c3-82e21f2f2705 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:24.316192 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-08bf682c-f935-4095-b1c3-82e21f2f2705 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] [instance: 99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:24.322509 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-08bf682c-f935-4095-b1c3-82e21f2f2705 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:24.323149 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-08bf682c-f935-4095-b1c3-82e21f2f2705 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:24.324757 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-08bf682c-f935-4095-b1c3-82e21f2f2705 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:24.325380 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-08bf682c-f935-4095-b1c3-82e21f2f2705 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:24.333017 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-70adc2ef-2f50-457e-8d2d-ccbe7657cf82 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917" status: 200 len: 1265 microversion: 2.1 time: 0.251004 Jun 03 10:00:24.334044 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 234/434] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:24 2022] GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917 => generated 1265 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:00:24.410671 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-08bf682c-f935-4095-b1c3-82e21f2f2705 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf34288d4ee46bcb04347985ebf2fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa11acd38ae14aeea91a05c97b166960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:24.420788 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-08bf682c-f935-4095-b1c3-82e21f2f2705 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] 10.222.0.45 "GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e" status: 200 len: 1211 microversion: 2.1 time: 0.109546 Jun 03 10:00:24.421885 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 201/435] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:24 2022] GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e => generated 1211 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:24.735993 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-a9374bf5-de60-47b4-8462-632a45f8d0c1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:24.736562 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-a9374bf5-de60-47b4-8462-632a45f8d0c1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:24.743045 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a9374bf5-de60-47b4-8462-632a45f8d0c1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:24.743600 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a9374bf5-de60-47b4-8462-632a45f8d0c1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:24.744419 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a9374bf5-de60-47b4-8462-632a45f8d0c1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:24.745057 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a9374bf5-de60-47b4-8462-632a45f8d0c1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:24.749450 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=100 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:00:24.871711 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-a9374bf5-de60-47b4-8462-632a45f8d0c1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:24.879984 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-a9374bf5-de60-47b4-8462-632a45f8d0c1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:24.881499 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-a9374bf5-de60-47b4-8462-632a45f8d0c1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:24.882676 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-a9374bf5-de60-47b4-8462-632a45f8d0c1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1744 microversion: 2.20 time: 0.150738 Jun 03 10:00:24.883228 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 235/436] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:24 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1744 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:25.316025 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-75450b26-6546-41bf-a4a9-7f66976e57c1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:25.316650 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-75450b26-6546-41bf-a4a9-7f66976e57c1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 2ecad1bf-3c89-4b29-a511-6e3d71a834fc] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:25.323108 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-75450b26-6546-41bf-a4a9-7f66976e57c1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:25.323558 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-75450b26-6546-41bf-a4a9-7f66976e57c1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:25.324319 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-75450b26-6546-41bf-a4a9-7f66976e57c1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:25.324758 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-75450b26-6546-41bf-a4a9-7f66976e57c1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:25.352022 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-19cb106e-66c8-4bb1-bc08-e7234e7303f4 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:25.353155 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-19cb106e-66c8-4bb1-bc08-e7234e7303f4 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: ac4d607d-8ff8-4931-b17d-460fda9c0917] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:25.360177 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-19cb106e-66c8-4bb1-bc08-e7234e7303f4 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:25.360730 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-19cb106e-66c8-4bb1-bc08-e7234e7303f4 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:25.361568 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-19cb106e-66c8-4bb1-bc08-e7234e7303f4 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:25.362289 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-19cb106e-66c8-4bb1-bc08-e7234e7303f4 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:25.545167 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-75450b26-6546-41bf-a4a9-7f66976e57c1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:25.554160 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-75450b26-6546-41bf-a4a9-7f66976e57c1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc" status: 200 len: 1365 microversion: 2.1 time: 0.242301 Jun 03 10:00:25.555174 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 202/437] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:25 2022] GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc => generated 1365 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:25.560196 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-0928fb1d-fa8e-473c-917a-c3dcd163ad04 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:25.560892 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-0928fb1d-fa8e-473c-917a-c3dcd163ad04 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] [instance: 99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:25.567668 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0928fb1d-fa8e-473c-917a-c3dcd163ad04 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:25.568208 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0928fb1d-fa8e-473c-917a-c3dcd163ad04 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:25.569056 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0928fb1d-fa8e-473c-917a-c3dcd163ad04 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:25.569563 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0928fb1d-fa8e-473c-917a-c3dcd163ad04 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:25.585371 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-19cb106e-66c8-4bb1-bc08-e7234e7303f4 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:25.594822 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-19cb106e-66c8-4bb1-bc08-e7234e7303f4 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917" status: 200 len: 1265 microversion: 2.1 time: 0.247629 Jun 03 10:00:25.603144 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 236/438] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:25 2022] GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917 => generated 1265 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:25.632933 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-0928fb1d-fa8e-473c-917a-c3dcd163ad04 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf34288d4ee46bcb04347985ebf2fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa11acd38ae14aeea91a05c97b166960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:25.640451 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-0928fb1d-fa8e-473c-917a-c3dcd163ad04 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] 10.222.0.45 "GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e" status: 200 len: 1273 microversion: 2.1 time: 0.084017 Jun 03 10:00:25.641525 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 203/439] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:25 2022] GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e => generated 1273 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:25.901999 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-99743fdf-e2ac-4239-99da-4bbb63672539 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:25.902614 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-99743fdf-e2ac-4239-99da-4bbb63672539 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:25.909544 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-99743fdf-e2ac-4239-99da-4bbb63672539 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:25.910025 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-99743fdf-e2ac-4239-99da-4bbb63672539 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:25.910799 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-99743fdf-e2ac-4239-99da-4bbb63672539 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:25.911236 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-99743fdf-e2ac-4239-99da-4bbb63672539 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:26.049776 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-99743fdf-e2ac-4239-99da-4bbb63672539 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:26.058053 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-99743fdf-e2ac-4239-99da-4bbb63672539 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:26.059567 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-99743fdf-e2ac-4239-99da-4bbb63672539 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:26.060724 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-99743fdf-e2ac-4239-99da-4bbb63672539 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1744 microversion: 2.20 time: 0.162748 Jun 03 10:00:26.061289 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 237/440] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:25 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:26.571017 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-52ec8cb3-ad62-4e0e-a4a2-9c5d43c32192 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:26.572428 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-52ec8cb3-ad62-4e0e-a4a2-9c5d43c32192 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 2ecad1bf-3c89-4b29-a511-6e3d71a834fc] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:26.579548 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-52ec8cb3-ad62-4e0e-a4a2-9c5d43c32192 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:26.580206 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-52ec8cb3-ad62-4e0e-a4a2-9c5d43c32192 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:26.580986 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-52ec8cb3-ad62-4e0e-a4a2-9c5d43c32192 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:26.581422 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-52ec8cb3-ad62-4e0e-a4a2-9c5d43c32192 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:26.616207 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-cfb0168c-466c-4584-9968-aeeada340cde tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:26.617444 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-cfb0168c-466c-4584-9968-aeeada340cde tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: ac4d607d-8ff8-4931-b17d-460fda9c0917] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:26.624504 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cfb0168c-466c-4584-9968-aeeada340cde tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:26.625010 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cfb0168c-466c-4584-9968-aeeada340cde tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:26.626430 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cfb0168c-466c-4584-9968-aeeada340cde tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:26.627212 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cfb0168c-466c-4584-9968-aeeada340cde tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:26.780813 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-52ec8cb3-ad62-4e0e-a4a2-9c5d43c32192 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:26.789811 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-52ec8cb3-ad62-4e0e-a4a2-9c5d43c32192 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc" status: 200 len: 1365 microversion: 2.1 time: 0.222557 Jun 03 10:00:26.790671 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 204/441] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:26 2022] GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc => generated 1365 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:26.803678 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-f5b167bb-1549-4221-898a-342a9bf84f77 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:26.804622 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-f5b167bb-1549-4221-898a-342a9bf84f77 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] [instance: 99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:26.811290 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f5b167bb-1549-4221-898a-342a9bf84f77 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:26.811743 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f5b167bb-1549-4221-898a-342a9bf84f77 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:26.811896 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-cfb0168c-466c-4584-9968-aeeada340cde tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:26.812872 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f5b167bb-1549-4221-898a-342a9bf84f77 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:26.813313 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f5b167bb-1549-4221-898a-342a9bf84f77 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:26.819809 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-cfb0168c-466c-4584-9968-aeeada340cde tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917" status: 200 len: 1265 microversion: 2.1 time: 0.212201 Jun 03 10:00:26.820476 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 238/442] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:26 2022] GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917 => generated 1265 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:00:26.945481 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f5b167bb-1549-4221-898a-342a9bf84f77 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf34288d4ee46bcb04347985ebf2fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa11acd38ae14aeea91a05c97b166960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:26.953212 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-f5b167bb-1549-4221-898a-342a9bf84f77 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] 10.222.0.45 "GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e" status: 200 len: 1315 microversion: 2.1 time: 0.161322 Jun 03 10:00:26.954183 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 205/443] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:26 2022] GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:27.079740 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-cccd1548-097e-421e-ada9-f08a989b761a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:27.080350 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-cccd1548-097e-421e-ada9-f08a989b761a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:27.086384 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cccd1548-097e-421e-ada9-f08a989b761a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:27.086833 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cccd1548-097e-421e-ada9-f08a989b761a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:27.087621 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cccd1548-097e-421e-ada9-f08a989b761a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:27.088084 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cccd1548-097e-421e-ada9-f08a989b761a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:27.220899 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-cccd1548-097e-421e-ada9-f08a989b761a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:27.228831 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-cccd1548-097e-421e-ada9-f08a989b761a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:27.230351 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-cccd1548-097e-421e-ada9-f08a989b761a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:27.231515 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-cccd1548-097e-421e-ada9-f08a989b761a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1744 microversion: 2.20 time: 0.155739 Jun 03 10:00:27.232070 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 239/444] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:27 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:27.807445 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-4a7ed778-576d-42fe-9cc3-1e0cdd52f3be tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:27.808053 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-4a7ed778-576d-42fe-9cc3-1e0cdd52f3be tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 2ecad1bf-3c89-4b29-a511-6e3d71a834fc] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:27.815342 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4a7ed778-576d-42fe-9cc3-1e0cdd52f3be tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:27.815787 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4a7ed778-576d-42fe-9cc3-1e0cdd52f3be tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:27.816554 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4a7ed778-576d-42fe-9cc3-1e0cdd52f3be tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:27.816981 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4a7ed778-576d-42fe-9cc3-1e0cdd52f3be tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:27.839151 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-462d695a-78d2-4b85-b33a-d7fc870094a0 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:27.840747 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-462d695a-78d2-4b85-b33a-d7fc870094a0 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: ac4d607d-8ff8-4931-b17d-460fda9c0917] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:27.849192 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-462d695a-78d2-4b85-b33a-d7fc870094a0 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:27.849947 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-462d695a-78d2-4b85-b33a-d7fc870094a0 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:27.851240 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-462d695a-78d2-4b85-b33a-d7fc870094a0 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:27.852079 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-462d695a-78d2-4b85-b33a-d7fc870094a0 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:28.025244 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-4a7ed778-576d-42fe-9cc3-1e0cdd52f3be tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:28.056857 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-4a7ed778-576d-42fe-9cc3-1e0cdd52f3be tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc" status: 200 len: 1365 microversion: 2.1 time: 0.253132 Jun 03 10:00:28.057652 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-462d695a-78d2-4b85-b33a-d7fc870094a0 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:28.066925 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-462d695a-78d2-4b85-b33a-d7fc870094a0 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917" status: 200 len: 1265 microversion: 2.1 time: 0.233030 Jun 03 10:00:28.067635 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 240/445] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:27 2022] GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917 => generated 1265 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:28.072328 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-07ae2d00-e269-466e-b0fd-81020aa95b50 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:28.073000 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-07ae2d00-e269-466e-b0fd-81020aa95b50 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] [instance: 99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:28.075754 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 206/446] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:27 2022] GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc => generated 1365 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:28.079097 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-07ae2d00-e269-466e-b0fd-81020aa95b50 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:28.079638 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-07ae2d00-e269-466e-b0fd-81020aa95b50 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:28.080474 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-07ae2d00-e269-466e-b0fd-81020aa95b50 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:28.080983 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-07ae2d00-e269-466e-b0fd-81020aa95b50 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:28.226167 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-07ae2d00-e269-466e-b0fd-81020aa95b50 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf34288d4ee46bcb04347985ebf2fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa11acd38ae14aeea91a05c97b166960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:28.234366 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-07ae2d00-e269-466e-b0fd-81020aa95b50 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] 10.222.0.45 "GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e" status: 200 len: 1315 microversion: 2.1 time: 0.165497 Jun 03 10:00:28.235471 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 241/447] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:28 2022] GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:28.253198 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-4d3026b2-ac99-4f79-853c-741308a6b07b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:28.253854 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-4d3026b2-ac99-4f79-853c-741308a6b07b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:28.261318 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4d3026b2-ac99-4f79-853c-741308a6b07b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:28.261846 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4d3026b2-ac99-4f79-853c-741308a6b07b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:28.262579 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4d3026b2-ac99-4f79-853c-741308a6b07b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:28.263017 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4d3026b2-ac99-4f79-853c-741308a6b07b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:28.443127 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-4d3026b2-ac99-4f79-853c-741308a6b07b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:28.451528 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-4d3026b2-ac99-4f79-853c-741308a6b07b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:28.453519 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-4d3026b2-ac99-4f79-853c-741308a6b07b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:28.454986 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-4d3026b2-ac99-4f79-853c-741308a6b07b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1744 microversion: 2.20 time: 0.209531 Jun 03 10:00:28.456057 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 207/448] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:28 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1744 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:28.526075 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-4745ceac-66ad-4d7c-a286-de31ec20aab8 req-5c56c6b8-fd1f-4f81-8bfe-1d27c16c5e53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e", "tag": "e5e295e9-435a-4123-809f-d35762180f58"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:00:28.539360 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-4745ceac-66ad-4d7c-a286-de31ec20aab8 req-5c56c6b8-fd1f-4f81-8bfe-1d27c16c5e53 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:28.540553 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-4745ceac-66ad-4d7c-a286-de31ec20aab8 req-5c56c6b8-fd1f-4f81-8bfe-1d27c16c5e53 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:28.569338 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-4745ceac-66ad-4d7c-a286-de31ec20aab8 req-5c56c6b8-fd1f-4f81-8bfe-1d27c16c5e53 service nova] Creating event network-changed:e5e295e9-435a-4123-809f-d35762180f58 for instance 99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e on hv-cinder-79760 Jun 03 10:00:28.582940 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-4745ceac-66ad-4d7c-a286-de31ec20aab8 req-5c56c6b8-fd1f-4f81-8bfe-1d27c16c5e53 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061088 Jun 03 10:00:28.583814 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 242/449] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 10:00:29.080898 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-75e7d373-9ee5-4ea5-be21-92d9b8cc917d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:29.081477 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-75e7d373-9ee5-4ea5-be21-92d9b8cc917d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 2ecad1bf-3c89-4b29-a511-6e3d71a834fc] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:29.088002 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-199a861c-5f44-43f9-b4da-f2dc9df248d2 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:29.090581 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-199a861c-5f44-43f9-b4da-f2dc9df248d2 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: ac4d607d-8ff8-4931-b17d-460fda9c0917] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:29.099075 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-75e7d373-9ee5-4ea5-be21-92d9b8cc917d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:29.099641 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-75e7d373-9ee5-4ea5-be21-92d9b8cc917d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:29.100297 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-75e7d373-9ee5-4ea5-be21-92d9b8cc917d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:29.100768 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-75e7d373-9ee5-4ea5-be21-92d9b8cc917d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:29.102591 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-199a861c-5f44-43f9-b4da-f2dc9df248d2 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:29.103792 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-199a861c-5f44-43f9-b4da-f2dc9df248d2 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:29.106319 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-199a861c-5f44-43f9-b4da-f2dc9df248d2 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:29.107187 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-199a861c-5f44-43f9-b4da-f2dc9df248d2 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:29.323009 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-199a861c-5f44-43f9-b4da-f2dc9df248d2 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:29.326858 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-75e7d373-9ee5-4ea5-be21-92d9b8cc917d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:29.331047 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-199a861c-5f44-43f9-b4da-f2dc9df248d2 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917" status: 200 len: 1265 microversion: 2.1 time: 0.247988 Jun 03 10:00:29.332754 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 243/450] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:29 2022] GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917 => generated 1265 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:29.337301 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-53d366b2-2131-4559-b6e0-9d0ec5f7cc52 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:29.337932 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-53d366b2-2131-4559-b6e0-9d0ec5f7cc52 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] [instance: 99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:29.343954 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-75e7d373-9ee5-4ea5-be21-92d9b8cc917d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc" status: 200 len: 1365 microversion: 2.1 time: 0.266988 Jun 03 10:00:29.347188 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-53d366b2-2131-4559-b6e0-9d0ec5f7cc52 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:29.347452 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-53d366b2-2131-4559-b6e0-9d0ec5f7cc52 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:29.348215 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-53d366b2-2131-4559-b6e0-9d0ec5f7cc52 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:29.348645 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-53d366b2-2131-4559-b6e0-9d0ec5f7cc52 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:29.357373 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 208/451] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:29 2022] GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc => generated 1365 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:29.476938 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-08a40682-aca0-45fe-8341-18434612a52b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:29.477868 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-08a40682-aca0-45fe-8341-18434612a52b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:29.485979 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-53d366b2-2131-4559-b6e0-9d0ec5f7cc52 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf34288d4ee46bcb04347985ebf2fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa11acd38ae14aeea91a05c97b166960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:29.488514 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-08a40682-aca0-45fe-8341-18434612a52b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:29.489389 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-08a40682-aca0-45fe-8341-18434612a52b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:29.491225 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-08a40682-aca0-45fe-8341-18434612a52b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:29.492031 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-08a40682-aca0-45fe-8341-18434612a52b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:29.494314 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-53d366b2-2131-4559-b6e0-9d0ec5f7cc52 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] 10.222.0.45 "GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e" status: 200 len: 1315 microversion: 2.1 time: 0.160469 Jun 03 10:00:29.495275 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 244/452] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:29 2022] GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:29.689228 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-08a40682-aca0-45fe-8341-18434612a52b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:29.699631 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-08a40682-aca0-45fe-8341-18434612a52b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:29.701471 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-08a40682-aca0-45fe-8341-18434612a52b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:29.702881 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-08a40682-aca0-45fe-8341-18434612a52b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1739 microversion: 2.20 time: 0.232394 Jun 03 10:00:29.704000 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 209/453] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:29 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1739 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:29.935546 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-2faa25f2-b453-4a33-8c03-b99081fdcde1 req-679873db-ad60-4f48-aa1d-f0533765deb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac4d607d-8ff8-4931-b17d-460fda9c0917", "name": "network-vif-plugged", "status": "completed", "tag": "f8af94cb-bdaf-478f-8c87-f417af511b7d"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:00:29.948799 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-2faa25f2-b453-4a33-8c03-b99081fdcde1 req-679873db-ad60-4f48-aa1d-f0533765deb5 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:29.949733 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-2faa25f2-b453-4a33-8c03-b99081fdcde1 req-679873db-ad60-4f48-aa1d-f0533765deb5 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:29.963900 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-2faa25f2-b453-4a33-8c03-b99081fdcde1 req-679873db-ad60-4f48-aa1d-f0533765deb5 service nova] Creating event network-vif-plugged:f8af94cb-bdaf-478f-8c87-f417af511b7d for instance ac4d607d-8ff8-4931-b17d-460fda9c0917 on hv-cinder-79760 Jun 03 10:00:29.971148 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-2faa25f2-b453-4a33-8c03-b99081fdcde1 req-679873db-ad60-4f48-aa1d-f0533765deb5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039427 Jun 03 10:00:29.972278 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 245/454] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:00:30.349218 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-4faa0212-6b95-4444-9cb1-71b3c90e5c74 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:30.349955 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-4faa0212-6b95-4444-9cb1-71b3c90e5c74 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: ac4d607d-8ff8-4931-b17d-460fda9c0917] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:30.360408 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4faa0212-6b95-4444-9cb1-71b3c90e5c74 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:30.361990 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4faa0212-6b95-4444-9cb1-71b3c90e5c74 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:30.363079 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4faa0212-6b95-4444-9cb1-71b3c90e5c74 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:30.365523 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-e5f77b6f-b3a3-420c-a448-f3f4e537994d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:30.366090 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4faa0212-6b95-4444-9cb1-71b3c90e5c74 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:30.366264 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-e5f77b6f-b3a3-420c-a448-f3f4e537994d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 2ecad1bf-3c89-4b29-a511-6e3d71a834fc] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:30.373552 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e5f77b6f-b3a3-420c-a448-f3f4e537994d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:30.374023 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e5f77b6f-b3a3-420c-a448-f3f4e537994d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:30.375053 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e5f77b6f-b3a3-420c-a448-f3f4e537994d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:30.375721 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e5f77b6f-b3a3-420c-a448-f3f4e537994d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:30.605586 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-4faa0212-6b95-4444-9cb1-71b3c90e5c74 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:30.619763 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-4faa0212-6b95-4444-9cb1-71b3c90e5c74 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917" status: 200 len: 1265 microversion: 2.1 time: 0.274249 Jun 03 10:00:30.620887 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 210/455] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:30 2022] GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917 => generated 1265 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:30.625808 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-f125ef5a-d57b-4a50-a21a-ec4d42b173ed tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:30.626643 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-f125ef5a-d57b-4a50-a21a-ec4d42b173ed tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] [instance: 99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:30.635834 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f125ef5a-d57b-4a50-a21a-ec4d42b173ed tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:30.636289 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f125ef5a-d57b-4a50-a21a-ec4d42b173ed tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:30.637077 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f125ef5a-d57b-4a50-a21a-ec4d42b173ed tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:30.640559 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f125ef5a-d57b-4a50-a21a-ec4d42b173ed tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:30.665934 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell1:SELECT=100 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:00:30.673577 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-e5f77b6f-b3a3-420c-a448-f3f4e537994d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:30.700443 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-e5f77b6f-b3a3-420c-a448-f3f4e537994d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc" status: 200 len: 1365 microversion: 2.1 time: 0.334262 Jun 03 10:00:30.701532 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 246/456] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:30 2022] GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc => generated 1365 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:00:30.732328 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-3d8b15e6-1af2-4988-b359-3c54cb425721 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:30.733386 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-3d8b15e6-1af2-4988-b359-3c54cb425721 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:30.745472 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3d8b15e6-1af2-4988-b359-3c54cb425721 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:30.746221 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3d8b15e6-1af2-4988-b359-3c54cb425721 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:30.747021 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3d8b15e6-1af2-4988-b359-3c54cb425721 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:30.747462 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3d8b15e6-1af2-4988-b359-3c54cb425721 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:30.886049 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f125ef5a-d57b-4a50-a21a-ec4d42b173ed tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf34288d4ee46bcb04347985ebf2fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa11acd38ae14aeea91a05c97b166960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:30.897240 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-f125ef5a-d57b-4a50-a21a-ec4d42b173ed tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] 10.222.0.45 "GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e" status: 200 len: 1315 microversion: 2.1 time: 0.274313 Jun 03 10:00:30.898195 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 211/457] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:30 2022] GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:30.965646 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-3d8b15e6-1af2-4988-b359-3c54cb425721 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:30.974683 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-3d8b15e6-1af2-4988-b359-3c54cb425721 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:30.976987 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-3d8b15e6-1af2-4988-b359-3c54cb425721 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:30.978924 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-3d8b15e6-1af2-4988-b359-3c54cb425721 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1739 microversion: 2.20 time: 0.260058 Jun 03 10:00:30.980108 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 247/458] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:30 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1739 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:31.639472 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-093e80ec-1998-437b-9555-fd46b5ffe672 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:31.640173 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-093e80ec-1998-437b-9555-fd46b5ffe672 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: ac4d607d-8ff8-4931-b17d-460fda9c0917] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:31.652705 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-093e80ec-1998-437b-9555-fd46b5ffe672 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:31.653444 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-093e80ec-1998-437b-9555-fd46b5ffe672 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:31.654438 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-093e80ec-1998-437b-9555-fd46b5ffe672 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:31.655092 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-093e80ec-1998-437b-9555-fd46b5ffe672 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:31.718326 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-5a41618e-d14e-43b7-a438-b9c135ecc522 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:31.719503 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-5a41618e-d14e-43b7-a438-b9c135ecc522 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 2ecad1bf-3c89-4b29-a511-6e3d71a834fc] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:31.728559 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5a41618e-d14e-43b7-a438-b9c135ecc522 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:31.732565 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5a41618e-d14e-43b7-a438-b9c135ecc522 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:31.735258 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5a41618e-d14e-43b7-a438-b9c135ecc522 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:31.738316 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5a41618e-d14e-43b7-a438-b9c135ecc522 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:32.003732 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-093e80ec-1998-437b-9555-fd46b5ffe672 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:32.018313 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-093e80ec-1998-437b-9555-fd46b5ffe672 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917" status: 200 len: 1265 microversion: 2.1 time: 0.383117 Jun 03 10:00:32.020101 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 212/459] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:31 2022] GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917 => generated 1265 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:32.034347 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-c719b92c-6cc9-43d5-9020-9ac3967e046c tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:32.038168 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-5a41618e-d14e-43b7-a438-b9c135ecc522 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:32.042254 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-c719b92c-6cc9-43d5-9020-9ac3967e046c tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] [instance: 99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:32.046562 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-5a41618e-d14e-43b7-a438-b9c135ecc522 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc" status: 200 len: 1365 microversion: 2.1 time: 0.332388 Jun 03 10:00:32.048619 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 248/460] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:31 2022] GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc => generated 1365 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:00:32.061380 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-db566a14-f64e-412a-a7cd-131eac3fc747 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:32.062514 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c719b92c-6cc9-43d5-9020-9ac3967e046c tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:32.064309 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c719b92c-6cc9-43d5-9020-9ac3967e046c tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:32.064673 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-db566a14-f64e-412a-a7cd-131eac3fc747 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:32.065666 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c719b92c-6cc9-43d5-9020-9ac3967e046c tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:32.069338 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c719b92c-6cc9-43d5-9020-9ac3967e046c tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:32.075973 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-db566a14-f64e-412a-a7cd-131eac3fc747 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:32.076693 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-db566a14-f64e-412a-a7cd-131eac3fc747 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:32.077580 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-db566a14-f64e-412a-a7cd-131eac3fc747 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:32.079267 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-db566a14-f64e-412a-a7cd-131eac3fc747 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:32.336082 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-c719b92c-6cc9-43d5-9020-9ac3967e046c tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf34288d4ee46bcb04347985ebf2fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa11acd38ae14aeea91a05c97b166960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:32.343466 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-db566a14-f64e-412a-a7cd-131eac3fc747 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:32.348841 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-c719b92c-6cc9-43d5-9020-9ac3967e046c tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] 10.222.0.45 "GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e" status: 200 len: 1315 microversion: 2.1 time: 0.325954 Jun 03 10:00:32.349849 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 213/461] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:32 2022] GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e => generated 1315 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:32.353366 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-db566a14-f64e-412a-a7cd-131eac3fc747 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:32.354921 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-db566a14-f64e-412a-a7cd-131eac3fc747 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:32.356093 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-db566a14-f64e-412a-a7cd-131eac3fc747 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1739 microversion: 2.20 time: 0.304062 Jun 03 10:00:32.356618 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-4b538c92-49bc-4e87-875d-a1c58c210c63 req-2a31145c-807e-4133-a041-54cea2d70be5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f", "name": "network-vif-plugged", "status": "completed", "tag": "d6b08e27-3091-4087-a29a-03ef6cbbdc0a"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:00:32.356763 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 249/462] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:32 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1739 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:32.365654 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-4b538c92-49bc-4e87-875d-a1c58c210c63 req-2a31145c-807e-4133-a041-54cea2d70be5 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:32.366676 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-4b538c92-49bc-4e87-875d-a1c58c210c63 req-2a31145c-807e-4133-a041-54cea2d70be5 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:32.398321 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-4b538c92-49bc-4e87-875d-a1c58c210c63 req-2a31145c-807e-4133-a041-54cea2d70be5 service nova] Creating event network-vif-plugged:d6b08e27-3091-4087-a29a-03ef6cbbdc0a for instance 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f on hv-cinder-79760 Jun 03 10:00:32.406058 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-4b538c92-49bc-4e87-875d-a1c58c210c63 req-2a31145c-807e-4133-a041-54cea2d70be5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054255 Jun 03 10:00:32.412965 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 214/463] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:00:33.041857 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-862900a0-fdb1-4638-9c79-ac319a81ceb3 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:33.043310 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-862900a0-fdb1-4638-9c79-ac319a81ceb3 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: ac4d607d-8ff8-4931-b17d-460fda9c0917] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:33.068337 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-f17aba7e-c466-4f58-a21c-ce198fb52aef tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:33.072108 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-f17aba7e-c466-4f58-a21c-ce198fb52aef tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 2ecad1bf-3c89-4b29-a511-6e3d71a834fc] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:33.087564 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-862900a0-fdb1-4638-9c79-ac319a81ceb3 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:33.091210 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-862900a0-fdb1-4638-9c79-ac319a81ceb3 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:33.092298 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-862900a0-fdb1-4638-9c79-ac319a81ceb3 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:33.094141 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f17aba7e-c466-4f58-a21c-ce198fb52aef tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:33.094888 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-862900a0-fdb1-4638-9c79-ac319a81ceb3 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:33.100487 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f17aba7e-c466-4f58-a21c-ce198fb52aef tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:33.101868 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f17aba7e-c466-4f58-a21c-ce198fb52aef tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:33.102651 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f17aba7e-c466-4f58-a21c-ce198fb52aef tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:33.388536 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f17aba7e-c466-4f58-a21c-ce198fb52aef tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:33.398616 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-862900a0-fdb1-4638-9c79-ac319a81ceb3 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:33.402135 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-f17aba7e-c466-4f58-a21c-ce198fb52aef tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc" status: 200 len: 1365 microversion: 2.1 time: 0.341119 Jun 03 10:00:33.403352 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 215/464] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:33 2022] GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc => generated 1365 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:33.415973 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-862900a0-fdb1-4638-9c79-ac319a81ceb3 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917" status: 200 len: 1265 microversion: 2.1 time: 0.383919 Jun 03 10:00:33.416980 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 250/465] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:33 2022] GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917 => generated 1265 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:33.425319 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-7df6c458-27fc-43db-af48-b5914ff4f714 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:33.428215 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-7df6c458-27fc-43db-af48-b5914ff4f714 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] [instance: 99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:33.431188 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-ed7c262e-17e2-4168-a156-1387be427211 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:33.432088 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-ed7c262e-17e2-4168-a156-1387be427211 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:33.443582 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7df6c458-27fc-43db-af48-b5914ff4f714 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:33.444042 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7df6c458-27fc-43db-af48-b5914ff4f714 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:33.445566 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ed7c262e-17e2-4168-a156-1387be427211 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:33.447159 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ed7c262e-17e2-4168-a156-1387be427211 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:33.448531 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ed7c262e-17e2-4168-a156-1387be427211 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:33.448766 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7df6c458-27fc-43db-af48-b5914ff4f714 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:33.449243 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7df6c458-27fc-43db-af48-b5914ff4f714 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:33.449357 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ed7c262e-17e2-4168-a156-1387be427211 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:33.723314 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-7df6c458-27fc-43db-af48-b5914ff4f714 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf34288d4ee46bcb04347985ebf2fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa11acd38ae14aeea91a05c97b166960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:33.738367 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-7df6c458-27fc-43db-af48-b5914ff4f714 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] 10.222.0.45 "GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e" status: 200 len: 1315 microversion: 2.1 time: 0.331076 Jun 03 10:00:33.738992 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 216/466] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:33 2022] GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e => generated 1315 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:33.789461 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-ed7c262e-17e2-4168-a156-1387be427211 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:33.801367 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-ed7c262e-17e2-4168-a156-1387be427211 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:33.804490 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-ed7c262e-17e2-4168-a156-1387be427211 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:33.808220 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-ed7c262e-17e2-4168-a156-1387be427211 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1739 microversion: 2.20 time: 0.389892 Jun 03 10:00:33.809550 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 251/467] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:33 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1739 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:34.421805 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-43d0f85e-b6cc-49df-aa51-d0cf572e4d6e tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:34.423598 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-43d0f85e-b6cc-49df-aa51-d0cf572e4d6e tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 2ecad1bf-3c89-4b29-a511-6e3d71a834fc] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:34.436056 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-410375a2-fc3b-48f8-b0e7-801e657170d1 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:34.437159 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-410375a2-fc3b-48f8-b0e7-801e657170d1 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: ac4d607d-8ff8-4931-b17d-460fda9c0917] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:34.437359 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-43d0f85e-b6cc-49df-aa51-d0cf572e4d6e tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:34.438552 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-43d0f85e-b6cc-49df-aa51-d0cf572e4d6e tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:34.439512 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-43d0f85e-b6cc-49df-aa51-d0cf572e4d6e tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:34.440095 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-43d0f85e-b6cc-49df-aa51-d0cf572e4d6e tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:34.448927 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-410375a2-fc3b-48f8-b0e7-801e657170d1 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:34.451139 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-410375a2-fc3b-48f8-b0e7-801e657170d1 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:34.452475 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-410375a2-fc3b-48f8-b0e7-801e657170d1 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:34.454854 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-410375a2-fc3b-48f8-b0e7-801e657170d1 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:34.766067 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-410375a2-fc3b-48f8-b0e7-801e657170d1 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:34.775360 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-410375a2-fc3b-48f8-b0e7-801e657170d1 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917" status: 200 len: 1452 microversion: 2.1 time: 0.346750 Jun 03 10:00:34.776227 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 252/468] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:34 2022] GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917 => generated 1452 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:34.781081 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-78371eff-b25e-401a-9e58-8c39286fadbf tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:34.782257 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-78371eff-b25e-401a-9e58-8c39286fadbf tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] [instance: 99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:34.796846 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-78371eff-b25e-401a-9e58-8c39286fadbf tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:34.798167 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-78371eff-b25e-401a-9e58-8c39286fadbf tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:34.799127 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-78371eff-b25e-401a-9e58-8c39286fadbf tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:34.799734 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-78371eff-b25e-401a-9e58-8c39286fadbf tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:34.804296 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=100 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:00:34.831634 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-43d0f85e-b6cc-49df-aa51-d0cf572e4d6e tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:34.874731 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-43d0f85e-b6cc-49df-aa51-d0cf572e4d6e tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc" status: 200 len: 1365 microversion: 2.1 time: 0.455091 Jun 03 10:00:34.878714 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 217/469] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:34 2022] GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc => generated 1365 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:34.887250 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-841eda6e-1550-4306-b305-7f55e9e74958 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:34.887861 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-841eda6e-1550-4306-b305-7f55e9e74958 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: ac4d607d-8ff8-4931-b17d-460fda9c0917] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:34.894580 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-841eda6e-1550-4306-b305-7f55e9e74958 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:34.895585 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-841eda6e-1550-4306-b305-7f55e9e74958 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:34.897071 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-841eda6e-1550-4306-b305-7f55e9e74958 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:34.898033 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-841eda6e-1550-4306-b305-7f55e9e74958 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:35.128386 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-78371eff-b25e-401a-9e58-8c39286fadbf tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf34288d4ee46bcb04347985ebf2fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa11acd38ae14aeea91a05c97b166960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:35.138315 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-78371eff-b25e-401a-9e58-8c39286fadbf tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] 10.222.0.45 "GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e" status: 200 len: 1315 microversion: 2.1 time: 0.360385 Jun 03 10:00:35.151394 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 253/470] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:34 2022] GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e => generated 1315 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:35.160101 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-34527804-110b-46d4-9e1a-b506c5595588 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:35.161040 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-34527804-110b-46d4-9e1a-b506c5595588 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:35.165407 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-841eda6e-1550-4306-b305-7f55e9e74958 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:35.170247 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-34527804-110b-46d4-9e1a-b506c5595588 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:35.170725 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-34527804-110b-46d4-9e1a-b506c5595588 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:35.171520 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-34527804-110b-46d4-9e1a-b506c5595588 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:35.172002 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-34527804-110b-46d4-9e1a-b506c5595588 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:35.181667 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-841eda6e-1550-4306-b305-7f55e9e74958 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917" status: 200 len: 1452 microversion: 2.1 time: 0.300992 Jun 03 10:00:35.183320 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 218/471] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:34 2022] GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917 => generated 1452 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:35.357966 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-34527804-110b-46d4-9e1a-b506c5595588 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:35.366655 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-34527804-110b-46d4-9e1a-b506c5595588 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:35.368581 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-34527804-110b-46d4-9e1a-b506c5595588 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:35.374042 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-34527804-110b-46d4-9e1a-b506c5595588 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1739 microversion: 2.20 time: 0.215492 Jun 03 10:00:35.375009 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 254/472] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:35 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1739 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:35.892524 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-a1f2ac7a-f9ad-45cd-9373-d96e17057960 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:35.893711 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-a1f2ac7a-f9ad-45cd-9373-d96e17057960 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 2ecad1bf-3c89-4b29-a511-6e3d71a834fc] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:35.913084 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a1f2ac7a-f9ad-45cd-9373-d96e17057960 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:35.914166 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a1f2ac7a-f9ad-45cd-9373-d96e17057960 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:35.915202 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a1f2ac7a-f9ad-45cd-9373-d96e17057960 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:35.915646 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a1f2ac7a-f9ad-45cd-9373-d96e17057960 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:36.158947 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-d6e2dbaa-8383-4e0c-bba8-d10bd93d2437 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:36.159566 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-d6e2dbaa-8383-4e0c-bba8-d10bd93d2437 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] [instance: 99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:36.176490 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d6e2dbaa-8383-4e0c-bba8-d10bd93d2437 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:36.177228 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d6e2dbaa-8383-4e0c-bba8-d10bd93d2437 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:36.178265 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d6e2dbaa-8383-4e0c-bba8-d10bd93d2437 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:36.181295 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d6e2dbaa-8383-4e0c-bba8-d10bd93d2437 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:36.229796 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-a1f2ac7a-f9ad-45cd-9373-d96e17057960 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:36.238692 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-a1f2ac7a-f9ad-45cd-9373-d96e17057960 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc" status: 200 len: 1365 microversion: 2.1 time: 0.350446 Jun 03 10:00:36.251450 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 219/473] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:35 2022] GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc => generated 1365 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:36.392965 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-13c0081e-b261-4c45-836f-0bdefaa16e42 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:36.394681 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-13c0081e-b261-4c45-836f-0bdefaa16e42 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:36.409214 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-13c0081e-b261-4c45-836f-0bdefaa16e42 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:36.409658 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-13c0081e-b261-4c45-836f-0bdefaa16e42 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:36.410481 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-13c0081e-b261-4c45-836f-0bdefaa16e42 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:36.410913 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-13c0081e-b261-4c45-836f-0bdefaa16e42 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:36.436813 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-d6e2dbaa-8383-4e0c-bba8-d10bd93d2437 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf34288d4ee46bcb04347985ebf2fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa11acd38ae14aeea91a05c97b166960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:36.445057 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-d6e2dbaa-8383-4e0c-bba8-d10bd93d2437 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] 10.222.0.45 "GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e" status: 200 len: 1315 microversion: 2.1 time: 0.292650 Jun 03 10:00:36.450384 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 255/474] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:36 2022] GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e => generated 1315 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:00:36.732087 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-13c0081e-b261-4c45-836f-0bdefaa16e42 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:36.741207 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-13c0081e-b261-4c45-836f-0bdefaa16e42 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:36.748406 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-13c0081e-b261-4c45-836f-0bdefaa16e42 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:36.752424 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-13c0081e-b261-4c45-836f-0bdefaa16e42 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1739 microversion: 2.20 time: 0.363805 Jun 03 10:00:36.753442 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 220/475] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:36 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1739 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 10:00:37.260201 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-ecd9c3ce-2215-4510-83bc-dc5bcd97b912 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:37.261825 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-ecd9c3ce-2215-4510-83bc-dc5bcd97b912 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 2ecad1bf-3c89-4b29-a511-6e3d71a834fc] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:37.268851 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=97 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:00:37.295225 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ecd9c3ce-2215-4510-83bc-dc5bcd97b912 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:37.298097 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ecd9c3ce-2215-4510-83bc-dc5bcd97b912 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:37.299147 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ecd9c3ce-2215-4510-83bc-dc5bcd97b912 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:37.304744 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ecd9c3ce-2215-4510-83bc-dc5bcd97b912 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:37.372761 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-e3e100db-dc92-429e-9687-223760f851de req-e53b4a30-5b26-4752-b5ca-e891bb776e7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e", "name": "network-vif-plugged", "status": "completed", "tag": "e5e295e9-435a-4123-809f-d35762180f58"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:00:37.399606 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-e3e100db-dc92-429e-9687-223760f851de req-e53b4a30-5b26-4752-b5ca-e891bb776e7d service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:37.400175 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-e3e100db-dc92-429e-9687-223760f851de req-e53b4a30-5b26-4752-b5ca-e891bb776e7d service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:37.425542 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-e3e100db-dc92-429e-9687-223760f851de req-e53b4a30-5b26-4752-b5ca-e891bb776e7d service nova] Creating event network-vif-plugged:e5e295e9-435a-4123-809f-d35762180f58 for instance 99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e on hv-cinder-79760 Jun 03 10:00:37.438797 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-e3e100db-dc92-429e-9687-223760f851de req-e53b4a30-5b26-4752-b5ca-e891bb776e7d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067627 Jun 03 10:00:37.441866 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 221/476] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jun 03 10:00:37.466523 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-3a9ee1e6-1601-4439-9b28-f9092a020b2a tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:37.473532 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-3a9ee1e6-1601-4439-9b28-f9092a020b2a tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] [instance: 99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:37.493147 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3a9ee1e6-1601-4439-9b28-f9092a020b2a tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:37.519134 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3a9ee1e6-1601-4439-9b28-f9092a020b2a tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:37.520042 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3a9ee1e6-1601-4439-9b28-f9092a020b2a tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:37.520517 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3a9ee1e6-1601-4439-9b28-f9092a020b2a tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:37.600512 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-ecd9c3ce-2215-4510-83bc-dc5bcd97b912 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:37.618700 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-ecd9c3ce-2215-4510-83bc-dc5bcd97b912 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc" status: 200 len: 1365 microversion: 2.1 time: 0.360544 Jun 03 10:00:37.621230 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 256/477] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:37 2022] GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc => generated 1365 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:37.773574 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-05d50308-00ea-45d3-a0d4-9fad6ce79b3a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:37.774237 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-05d50308-00ea-45d3-a0d4-9fad6ce79b3a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:37.785368 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-05d50308-00ea-45d3-a0d4-9fad6ce79b3a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:37.786037 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-05d50308-00ea-45d3-a0d4-9fad6ce79b3a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:37.786843 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-05d50308-00ea-45d3-a0d4-9fad6ce79b3a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:37.790199 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-05d50308-00ea-45d3-a0d4-9fad6ce79b3a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:37.871683 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-3a9ee1e6-1601-4439-9b28-f9092a020b2a tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf34288d4ee46bcb04347985ebf2fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa11acd38ae14aeea91a05c97b166960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:37.885725 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-3a9ee1e6-1601-4439-9b28-f9092a020b2a tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] 10.222.0.45 "GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e" status: 200 len: 1315 microversion: 2.1 time: 0.425192 Jun 03 10:00:37.887138 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 222/478] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:37 2022] GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e => generated 1315 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:38.057003 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-05d50308-00ea-45d3-a0d4-9fad6ce79b3a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:38.122005 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-05d50308-00ea-45d3-a0d4-9fad6ce79b3a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:38.123942 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-05d50308-00ea-45d3-a0d4-9fad6ce79b3a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:38.126211 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-05d50308-00ea-45d3-a0d4-9fad6ce79b3a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1739 microversion: 2.20 time: 0.357686 Jun 03 10:00:38.128039 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 257/479] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:37 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1739 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 10:00:38.638789 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-c1210ef2-67d4-4c04-84db-cb210438964c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:38.639524 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-c1210ef2-67d4-4c04-84db-cb210438964c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 2ecad1bf-3c89-4b29-a511-6e3d71a834fc] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:38.653327 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c1210ef2-67d4-4c04-84db-cb210438964c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:38.654154 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c1210ef2-67d4-4c04-84db-cb210438964c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:38.655131 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c1210ef2-67d4-4c04-84db-cb210438964c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:38.655782 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c1210ef2-67d4-4c04-84db-cb210438964c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:38.858214 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-c1210ef2-67d4-4c04-84db-cb210438964c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:38.874519 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-c1210ef2-67d4-4c04-84db-cb210438964c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc" status: 200 len: 1365 microversion: 2.1 time: 0.238870 Jun 03 10:00:38.886102 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 223/480] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:38 2022] GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc => generated 1365 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:38.903079 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-6b9106b4-4906-4521-b64c-5d2439a4d353 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:38.903643 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-6b9106b4-4906-4521-b64c-5d2439a4d353 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] [instance: 99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:38.911302 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6b9106b4-4906-4521-b64c-5d2439a4d353 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:38.911757 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6b9106b4-4906-4521-b64c-5d2439a4d353 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:38.912544 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6b9106b4-4906-4521-b64c-5d2439a4d353 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:38.912983 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6b9106b4-4906-4521-b64c-5d2439a4d353 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:39.117507 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-6b9106b4-4906-4521-b64c-5d2439a4d353 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf34288d4ee46bcb04347985ebf2fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa11acd38ae14aeea91a05c97b166960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:39.126287 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-6b9106b4-4906-4521-b64c-5d2439a4d353 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] 10.222.0.45 "GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e" status: 200 len: 1315 microversion: 2.1 time: 0.226919 Jun 03 10:00:39.137996 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 258/481] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:38 2022] GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:39.160212 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-7c46ffa0-cd79-4eee-b76f-fef436ea0843 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:39.160673 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-7c46ffa0-cd79-4eee-b76f-fef436ea0843 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:39.173574 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7c46ffa0-cd79-4eee-b76f-fef436ea0843 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:39.174324 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7c46ffa0-cd79-4eee-b76f-fef436ea0843 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:39.175462 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7c46ffa0-cd79-4eee-b76f-fef436ea0843 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:39.176055 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7c46ffa0-cd79-4eee-b76f-fef436ea0843 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:39.392760 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-7c46ffa0-cd79-4eee-b76f-fef436ea0843 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:39.406706 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-7c46ffa0-cd79-4eee-b76f-fef436ea0843 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:39.408416 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-7c46ffa0-cd79-4eee-b76f-fef436ea0843 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:39.409783 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-7c46ffa0-cd79-4eee-b76f-fef436ea0843 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1739 microversion: 2.20 time: 0.256428 Jun 03 10:00:39.420324 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 224/482] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:39 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1739 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:39.583623 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-ee6610bc-8236-49fa-85aa-aae735546114 req-4a3f52e3-0088-4459-bd1f-f8494571a5b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ecad1bf-3c89-4b29-a511-6e3d71a834fc", "name": "network-vif-plugged", "status": "completed", "tag": "9e1af8da-841e-40c5-97a6-85870409a32f"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:00:39.604578 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-ee6610bc-8236-49fa-85aa-aae735546114 req-4a3f52e3-0088-4459-bd1f-f8494571a5b3 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:39.612425 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-ee6610bc-8236-49fa-85aa-aae735546114 req-4a3f52e3-0088-4459-bd1f-f8494571a5b3 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:39.632484 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-09f2e5f2-75a6-45a8-bb79-d4dead0ac441 req-5c3e9fe8-c6c5-4301-8e14-f9ec62a6ed9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac4d607d-8ff8-4931-b17d-460fda9c0917", "tag": "f8af94cb-bdaf-478f-8c87-f417af511b7d"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:00:39.649475 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-09f2e5f2-75a6-45a8-bb79-d4dead0ac441 req-5c3e9fe8-c6c5-4301-8e14-f9ec62a6ed9e service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:39.650184 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-09f2e5f2-75a6-45a8-bb79-d4dead0ac441 req-5c3e9fe8-c6c5-4301-8e14-f9ec62a6ed9e service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:39.660459 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-ee6610bc-8236-49fa-85aa-aae735546114 req-4a3f52e3-0088-4459-bd1f-f8494571a5b3 service nova] Creating event network-vif-plugged:9e1af8da-841e-40c5-97a6-85870409a32f for instance 2ecad1bf-3c89-4b29-a511-6e3d71a834fc on hv-cinder-79760 Jun 03 10:00:39.675545 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-ee6610bc-8236-49fa-85aa-aae735546114 req-4a3f52e3-0088-4459-bd1f-f8494571a5b3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097649 Jun 03 10:00:39.681843 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 259/483] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 10:00:39.683312 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-09f2e5f2-75a6-45a8-bb79-d4dead0ac441 req-5c3e9fe8-c6c5-4301-8e14-f9ec62a6ed9e service nova] Creating event network-changed:f8af94cb-bdaf-478f-8c87-f417af511b7d for instance ac4d607d-8ff8-4931-b17d-460fda9c0917 on hv-cinder-79760 Jun 03 10:00:39.691836 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-09f2e5f2-75a6-45a8-bb79-d4dead0ac441 req-5c3e9fe8-c6c5-4301-8e14-f9ec62a6ed9e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064974 Jun 03 10:00:39.694073 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 225/484] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:00:39.893927 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-346af05b-a251-4f38-b2bd-88cabbba2428 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:39.895167 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-346af05b-a251-4f38-b2bd-88cabbba2428 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 2ecad1bf-3c89-4b29-a511-6e3d71a834fc] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:39.908741 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-346af05b-a251-4f38-b2bd-88cabbba2428 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:39.912056 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-346af05b-a251-4f38-b2bd-88cabbba2428 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:39.923625 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-346af05b-a251-4f38-b2bd-88cabbba2428 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:39.925704 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-346af05b-a251-4f38-b2bd-88cabbba2428 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:40.147080 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-7bb8aa56-01c1-4490-99c9-174af08c4389 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:40.149916 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-7bb8aa56-01c1-4490-99c9-174af08c4389 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] [instance: 99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:40.164377 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7bb8aa56-01c1-4490-99c9-174af08c4389 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:40.174040 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-346af05b-a251-4f38-b2bd-88cabbba2428 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:40.179104 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7bb8aa56-01c1-4490-99c9-174af08c4389 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:40.182128 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7bb8aa56-01c1-4490-99c9-174af08c4389 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:40.186032 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-346af05b-a251-4f38-b2bd-88cabbba2428 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc" status: 200 len: 1365 microversion: 2.1 time: 0.297268 Jun 03 10:00:40.187162 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7bb8aa56-01c1-4490-99c9-174af08c4389 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:40.206680 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 260/485] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:39 2022] GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc => generated 1365 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:40.428507 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-f2b2e8ae-75ef-4a8d-9217-3af1e430f872 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:40.429620 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-f2b2e8ae-75ef-4a8d-9217-3af1e430f872 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:40.451371 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f2b2e8ae-75ef-4a8d-9217-3af1e430f872 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:40.454471 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f2b2e8ae-75ef-4a8d-9217-3af1e430f872 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:40.457687 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f2b2e8ae-75ef-4a8d-9217-3af1e430f872 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:40.459657 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f2b2e8ae-75ef-4a8d-9217-3af1e430f872 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:40.550476 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-7bb8aa56-01c1-4490-99c9-174af08c4389 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf34288d4ee46bcb04347985ebf2fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa11acd38ae14aeea91a05c97b166960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:40.562862 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-7bb8aa56-01c1-4490-99c9-174af08c4389 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] 10.222.0.45 "GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e" status: 200 len: 1315 microversion: 2.1 time: 0.421723 Jun 03 10:00:40.565686 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 226/486] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:40 2022] GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e => generated 1315 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:40.809158 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-f2b2e8ae-75ef-4a8d-9217-3af1e430f872 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:40.834294 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-f2b2e8ae-75ef-4a8d-9217-3af1e430f872 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:40.835838 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-f2b2e8ae-75ef-4a8d-9217-3af1e430f872 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:40.837034 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-f2b2e8ae-75ef-4a8d-9217-3af1e430f872 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1739 microversion: 2.20 time: 0.412930 Jun 03 10:00:40.843705 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 261/487] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:40 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1739 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:41.209483 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-92883568-373b-4e4a-aae3-77c93b2ff816 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:41.210124 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-92883568-373b-4e4a-aae3-77c93b2ff816 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 2ecad1bf-3c89-4b29-a511-6e3d71a834fc] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:41.227108 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-92883568-373b-4e4a-aae3-77c93b2ff816 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:41.227820 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-92883568-373b-4e4a-aae3-77c93b2ff816 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:41.228850 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-92883568-373b-4e4a-aae3-77c93b2ff816 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:41.229499 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-92883568-373b-4e4a-aae3-77c93b2ff816 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:41.582049 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-80ee92ab-deb4-445d-a09f-67e11712e868 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:41.583750 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-80ee92ab-deb4-445d-a09f-67e11712e868 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] [instance: 99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:41.595750 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-80ee92ab-deb4-445d-a09f-67e11712e868 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:41.598953 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-80ee92ab-deb4-445d-a09f-67e11712e868 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:41.600017 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-80ee92ab-deb4-445d-a09f-67e11712e868 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:41.600693 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-80ee92ab-deb4-445d-a09f-67e11712e868 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:41.631130 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-92883568-373b-4e4a-aae3-77c93b2ff816 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:41.644021 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-92883568-373b-4e4a-aae3-77c93b2ff816 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc" status: 200 len: 1365 microversion: 2.1 time: 0.435149 Jun 03 10:00:41.654224 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 227/488] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:41 2022] GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc => generated 1365 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:41.855268 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-58b5effb-d891-45ec-a60d-f28d6b36e239 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:41.856311 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-58b5effb-d891-45ec-a60d-f28d6b36e239 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:41.871123 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-58b5effb-d891-45ec-a60d-f28d6b36e239 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:41.876154 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-58b5effb-d891-45ec-a60d-f28d6b36e239 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:41.877320 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-58b5effb-d891-45ec-a60d-f28d6b36e239 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:41.877797 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-58b5effb-d891-45ec-a60d-f28d6b36e239 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:42.044303 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-80ee92ab-deb4-445d-a09f-67e11712e868 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf34288d4ee46bcb04347985ebf2fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa11acd38ae14aeea91a05c97b166960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:42.058553 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-80ee92ab-deb4-445d-a09f-67e11712e868 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] 10.222.0.45 "GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e" status: 200 len: 1465 microversion: 2.1 time: 0.481193 Jun 03 10:00:42.059553 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 262/489] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:41 2022] GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e => generated 1465 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:00:42.170180 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-58b5effb-d891-45ec-a60d-f28d6b36e239 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:42.181675 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-58b5effb-d891-45ec-a60d-f28d6b36e239 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:42.184310 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-58b5effb-d891-45ec-a60d-f28d6b36e239 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:42.184483 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-58b5effb-d891-45ec-a60d-f28d6b36e239 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1739 microversion: 2.20 time: 0.333620 Jun 03 10:00:42.184949 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 228/490] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:41 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1739 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:42.200678 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-65a01174-d650-466c-ba30-cab5cd67ff17 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:42.201197 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-65a01174-d650-466c-ba30-cab5cd67ff17 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] [instance: 99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:42.214451 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-65a01174-d650-466c-ba30-cab5cd67ff17 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:42.214914 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-65a01174-d650-466c-ba30-cab5cd67ff17 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:42.215710 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-65a01174-d650-466c-ba30-cab5cd67ff17 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:42.216172 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-65a01174-d650-466c-ba30-cab5cd67ff17 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:42.274557 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-65a01174-d650-466c-ba30-cab5cd67ff17 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] [instance: 99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e] Going to try to terminate instance {{(pid=117647) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 10:00:42.422345 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-65a01174-d650-466c-ba30-cab5cd67ff17 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] 10.222.0.45 "DELETE /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e" status: 204 len: 0 microversion: 2.1 time: 0.294854 Jun 03 10:00:42.423153 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 263/491] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jun 3 10:00:42 2022] DELETE /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 10:00:42.431457 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-88bdea0d-4411-4dd3-83e6-b758131916a1 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:42.432080 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-88bdea0d-4411-4dd3-83e6-b758131916a1 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] [instance: 99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:42.444741 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-88bdea0d-4411-4dd3-83e6-b758131916a1 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:42.445208 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-88bdea0d-4411-4dd3-83e6-b758131916a1 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:42.447975 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-88bdea0d-4411-4dd3-83e6-b758131916a1 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:42.449098 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-88bdea0d-4411-4dd3-83e6-b758131916a1 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:42.661545 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-51151991-bb9c-4c72-a518-4bc309ee4e73 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:42.662309 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-51151991-bb9c-4c72-a518-4bc309ee4e73 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 2ecad1bf-3c89-4b29-a511-6e3d71a834fc] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:42.674768 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-51151991-bb9c-4c72-a518-4bc309ee4e73 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:42.679345 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-51151991-bb9c-4c72-a518-4bc309ee4e73 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:42.680198 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-51151991-bb9c-4c72-a518-4bc309ee4e73 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:42.680645 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-51151991-bb9c-4c72-a518-4bc309ee4e73 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:42.786590 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-88bdea0d-4411-4dd3-83e6-b758131916a1 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf34288d4ee46bcb04347985ebf2fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa11acd38ae14aeea91a05c97b166960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:42.796407 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-88bdea0d-4411-4dd3-83e6-b758131916a1 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] 10.222.0.45 "GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e" status: 200 len: 1471 microversion: 2.1 time: 0.369031 Jun 03 10:00:42.798633 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 229/492] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:42 2022] GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e => generated 1471 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:43.121438 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-51151991-bb9c-4c72-a518-4bc309ee4e73 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:43.137396 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-51151991-bb9c-4c72-a518-4bc309ee4e73 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc" status: 200 len: 1365 microversion: 2.1 time: 0.480158 Jun 03 10:00:43.149010 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 264/493] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:42 2022] GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc => generated 1365 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:43.202822 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-971f9c0b-fb70-48bc-aee8-9996d0106411 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:43.203490 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-971f9c0b-fb70-48bc-aee8-9996d0106411 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:43.220065 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-971f9c0b-fb70-48bc-aee8-9996d0106411 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:43.220525 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-971f9c0b-fb70-48bc-aee8-9996d0106411 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:43.221315 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-971f9c0b-fb70-48bc-aee8-9996d0106411 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:43.221781 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-971f9c0b-fb70-48bc-aee8-9996d0106411 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:43.224763 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell1:SELECT=100 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:00:43.549936 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-971f9c0b-fb70-48bc-aee8-9996d0106411 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:43.561129 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-971f9c0b-fb70-48bc-aee8-9996d0106411 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:43.567231 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-971f9c0b-fb70-48bc-aee8-9996d0106411 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:43.571449 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-971f9c0b-fb70-48bc-aee8-9996d0106411 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1739 microversion: 2.20 time: 0.372427 Jun 03 10:00:43.572681 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 230/494] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:43 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1739 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:43.820183 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-cfb697b2-98cf-4782-a211-a43e76e8007e tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:43.821847 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-cfb697b2-98cf-4782-a211-a43e76e8007e tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] [instance: 99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:43.833694 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cfb697b2-98cf-4782-a211-a43e76e8007e tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:43.845579 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cfb697b2-98cf-4782-a211-a43e76e8007e tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:43.847848 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cfb697b2-98cf-4782-a211-a43e76e8007e tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:43.848427 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cfb697b2-98cf-4782-a211-a43e76e8007e tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:44.156863 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-beedd946-21c8-4abe-a6ef-4d3636d3328e tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:44.158020 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-beedd946-21c8-4abe-a6ef-4d3636d3328e tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 2ecad1bf-3c89-4b29-a511-6e3d71a834fc] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:44.170601 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-beedd946-21c8-4abe-a6ef-4d3636d3328e tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:44.171383 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-beedd946-21c8-4abe-a6ef-4d3636d3328e tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:44.172410 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-beedd946-21c8-4abe-a6ef-4d3636d3328e tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:44.173542 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-beedd946-21c8-4abe-a6ef-4d3636d3328e tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:44.425440 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-cfb697b2-98cf-4782-a211-a43e76e8007e tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf34288d4ee46bcb04347985ebf2fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa11acd38ae14aeea91a05c97b166960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:44.435355 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-cfb697b2-98cf-4782-a211-a43e76e8007e tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] 10.222.0.45 "GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e" status: 200 len: 1471 microversion: 2.1 time: 0.619773 Jun 03 10:00:44.442086 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 265/495] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:43 2022] GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e => generated 1471 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:44.593581 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-5928cbdd-7a1e-4dfd-a289-fe1e72c8bbf8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:44.594493 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-5928cbdd-7a1e-4dfd-a289-fe1e72c8bbf8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:44.611971 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5928cbdd-7a1e-4dfd-a289-fe1e72c8bbf8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:44.612693 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5928cbdd-7a1e-4dfd-a289-fe1e72c8bbf8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:44.613589 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5928cbdd-7a1e-4dfd-a289-fe1e72c8bbf8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:44.614164 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5928cbdd-7a1e-4dfd-a289-fe1e72c8bbf8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:44.960354 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-5928cbdd-7a1e-4dfd-a289-fe1e72c8bbf8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:44.962539 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-beedd946-21c8-4abe-a6ef-4d3636d3328e tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:44.976919 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-5928cbdd-7a1e-4dfd-a289-fe1e72c8bbf8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:44.980966 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-5928cbdd-7a1e-4dfd-a289-fe1e72c8bbf8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:44.982485 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-5928cbdd-7a1e-4dfd-a289-fe1e72c8bbf8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1739 microversion: 2.20 time: 0.392840 Jun 03 10:00:44.983302 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 266/496] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:44 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1739 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:44.984011 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-beedd946-21c8-4abe-a6ef-4d3636d3328e tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc" status: 200 len: 1365 microversion: 2.1 time: 0.832011 Jun 03 10:00:44.986535 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 231/497] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:44 2022] GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc => generated 1365 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:45.462350 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-9bd9c68a-38fa-40c4-885d-d76dd28fc912 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:45.463491 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-9bd9c68a-38fa-40c4-885d-d76dd28fc912 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] [instance: 99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:45.471094 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9bd9c68a-38fa-40c4-885d-d76dd28fc912 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:45.471648 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9bd9c68a-38fa-40c4-885d-d76dd28fc912 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:45.472523 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9bd9c68a-38fa-40c4-885d-d76dd28fc912 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:45.473058 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9bd9c68a-38fa-40c4-885d-d76dd28fc912 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:45.729989 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-9bd9c68a-38fa-40c4-885d-d76dd28fc912 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf34288d4ee46bcb04347985ebf2fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa11acd38ae14aeea91a05c97b166960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:45.738452 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-9bd9c68a-38fa-40c4-885d-d76dd28fc912 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] 10.222.0.45 "GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e" status: 200 len: 1471 microversion: 2.1 time: 0.281439 Jun 03 10:00:45.750131 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 267/498] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:45 2022] GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e => generated 1471 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:46.004029 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-ab9a65d5-94a1-422c-b082-68270865fc8d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:46.005564 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-ab9a65d5-94a1-422c-b082-68270865fc8d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 2ecad1bf-3c89-4b29-a511-6e3d71a834fc] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:46.015252 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-436f3f3f-4d3d-431f-8eb8-1d90281e2cad tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:46.016595 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-436f3f3f-4d3d-431f-8eb8-1d90281e2cad tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:46.038742 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_api:SELECT=98 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:00:46.040655 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ab9a65d5-94a1-422c-b082-68270865fc8d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:46.042627 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ab9a65d5-94a1-422c-b082-68270865fc8d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:46.043608 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ab9a65d5-94a1-422c-b082-68270865fc8d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:46.044045 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ab9a65d5-94a1-422c-b082-68270865fc8d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:46.044487 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-436f3f3f-4d3d-431f-8eb8-1d90281e2cad tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:46.045449 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-436f3f3f-4d3d-431f-8eb8-1d90281e2cad tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:46.046282 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-436f3f3f-4d3d-431f-8eb8-1d90281e2cad tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:46.047290 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-436f3f3f-4d3d-431f-8eb8-1d90281e2cad tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:46.287991 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-ab9a65d5-94a1-422c-b082-68270865fc8d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:46.297599 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-ab9a65d5-94a1-422c-b082-68270865fc8d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc" status: 200 len: 1365 microversion: 2.1 time: 0.297232 Jun 03 10:00:46.298366 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 232/499] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:45 2022] GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc => generated 1365 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:46.301636 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-436f3f3f-4d3d-431f-8eb8-1d90281e2cad tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:46.319144 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:00:46.325669 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-436f3f3f-4d3d-431f-8eb8-1d90281e2cad tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:46.327595 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-436f3f3f-4d3d-431f-8eb8-1d90281e2cad tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:46.329064 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-436f3f3f-4d3d-431f-8eb8-1d90281e2cad tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1739 microversion: 2.20 time: 0.317787 Jun 03 10:00:46.330354 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 268/500] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:46 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1739 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:46.757713 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-f4a01c24-6e0b-4500-a18d-f678229c5ce5 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:46.758465 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-f4a01c24-6e0b-4500-a18d-f678229c5ce5 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] [instance: 99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:46.765051 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f4a01c24-6e0b-4500-a18d-f678229c5ce5 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:46.765777 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f4a01c24-6e0b-4500-a18d-f678229c5ce5 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:46.766756 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f4a01c24-6e0b-4500-a18d-f678229c5ce5 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:46.767363 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f4a01c24-6e0b-4500-a18d-f678229c5ce5 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:46.920221 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f4a01c24-6e0b-4500-a18d-f678229c5ce5 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf34288d4ee46bcb04347985ebf2fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa11acd38ae14aeea91a05c97b166960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:46.928514 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-f4a01c24-6e0b-4500-a18d-f678229c5ce5 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] 10.222.0.45 "GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e" status: 200 len: 1471 microversion: 2.1 time: 0.174673 Jun 03 10:00:46.929366 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 233/501] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:46 2022] GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e => generated 1471 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:47.317605 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-d885615e-5d1f-419b-aeee-5737d01b5359 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:47.323175 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-d885615e-5d1f-419b-aeee-5737d01b5359 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 2ecad1bf-3c89-4b29-a511-6e3d71a834fc] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:47.335141 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d885615e-5d1f-419b-aeee-5737d01b5359 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:47.337942 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d885615e-5d1f-419b-aeee-5737d01b5359 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:47.338773 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d885615e-5d1f-419b-aeee-5737d01b5359 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:47.349504 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-9f3ad406-c73d-409d-85e1-b20e52bc506a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:47.350162 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-9f3ad406-c73d-409d-85e1-b20e52bc506a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:47.356434 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d885615e-5d1f-419b-aeee-5737d01b5359 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:47.361494 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9f3ad406-c73d-409d-85e1-b20e52bc506a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:47.361984 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9f3ad406-c73d-409d-85e1-b20e52bc506a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:47.366701 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9f3ad406-c73d-409d-85e1-b20e52bc506a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:47.370682 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9f3ad406-c73d-409d-85e1-b20e52bc506a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:47.583524 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-d885615e-5d1f-419b-aeee-5737d01b5359 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:47.594930 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-d885615e-5d1f-419b-aeee-5737d01b5359 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc" status: 200 len: 1555 microversion: 2.1 time: 0.284224 Jun 03 10:00:47.595977 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 269/502] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:47 2022] GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc => generated 1555 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:47.611584 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-e908ba7c-5890-4787-83db-937fc4033025 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:47.612370 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-e908ba7c-5890-4787-83db-937fc4033025 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 2ecad1bf-3c89-4b29-a511-6e3d71a834fc] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:47.627353 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e908ba7c-5890-4787-83db-937fc4033025 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:47.628484 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e908ba7c-5890-4787-83db-937fc4033025 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:47.631394 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e908ba7c-5890-4787-83db-937fc4033025 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:47.632753 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e908ba7c-5890-4787-83db-937fc4033025 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:47.778431 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-e908ba7c-5890-4787-83db-937fc4033025 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.171158 Jun 03 10:00:47.779276 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 270/503] 10.222.0.45 () {58 vars in 1274 bytes} [Fri Jun 3 10:00:47 2022] GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc/os-interface => generated 284 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 10:00:47.866339 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-9f3ad406-c73d-409d-85e1-b20e52bc506a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:47.876748 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-9f3ad406-c73d-409d-85e1-b20e52bc506a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:47.880398 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-9f3ad406-c73d-409d-85e1-b20e52bc506a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:47.883069 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-9f3ad406-c73d-409d-85e1-b20e52bc506a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1739 microversion: 2.20 time: 0.537758 Jun 03 10:00:47.885540 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 234/504] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:47 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1739 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:47.946047 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-c0a6949d-c560-4bc2-8605-6e98372c5a03 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:47.949931 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-c0a6949d-c560-4bc2-8605-6e98372c5a03 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] [instance: 99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:47.960018 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c0a6949d-c560-4bc2-8605-6e98372c5a03 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:47.960636 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c0a6949d-c560-4bc2-8605-6e98372c5a03 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:47.962048 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c0a6949d-c560-4bc2-8605-6e98372c5a03 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:47.962527 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c0a6949d-c560-4bc2-8605-6e98372c5a03 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:48.446054 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-c0a6949d-c560-4bc2-8605-6e98372c5a03 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf34288d4ee46bcb04347985ebf2fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa11acd38ae14aeea91a05c97b166960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:48.468070 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-c0a6949d-c560-4bc2-8605-6e98372c5a03 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] 10.222.0.45 "GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e" status: 200 len: 1471 microversion: 2.1 time: 0.525796 Jun 03 10:00:48.478395 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 271/505] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:47 2022] GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e => generated 1471 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:48.750990 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-905c1a8e-f315-4f99-9b06-ae825886c6e6 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Action: 'create', calling method: .version_select at 0x7f5036cb8a60>, body: {"keypair": {"name": "tempest-TestShelveInstance-2036788610", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPlI+8C1/whkpJFfTD8zAaKQwX+xz2hDMuuVCu8rFcti/jsVlGsnL0gy9wKnOyIG4P5xrJ56UOKgtjkOUlz33ozP9NE0fLB0/9f9WyQ5/3uJd/NRW3PX4gQyczZ3fn9xzg=="}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:00:48.769185 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-905c1a8e-f315-4f99-9b06-ae825886c6e6 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Getting quotas for project 475a588bd5a64b508dadf3d93fa5370c. Resources: {'key_pairs'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 10:00:48.774003 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-905c1a8e-f315-4f99-9b06-ae825886c6e6 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Getting quotas for user 3b1e4b0732d34ec896c84cb52a297447 and project 475a588bd5a64b508dadf3d93fa5370c. Resources: {'key_pairs'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 10:00:48.828160 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-905c1a8e-f315-4f99-9b06-ae825886c6e6 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.366305 Jun 03 10:00:48.828773 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 235/506] 10.222.0.45 () {60 vars in 1158 bytes} [Fri Jun 3 10:00:48 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 10:00:48.903366 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-3212699e-cfe1-4e61-9fbd-e266cf449a34 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:48.903973 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-3212699e-cfe1-4e61-9fbd-e266cf449a34 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:48.910818 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3212699e-cfe1-4e61-9fbd-e266cf449a34 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:48.911270 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3212699e-cfe1-4e61-9fbd-e266cf449a34 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:48.912036 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3212699e-cfe1-4e61-9fbd-e266cf449a34 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:48.912464 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3212699e-cfe1-4e61-9fbd-e266cf449a34 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:49.181945 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-66f652ea-8910-42df-88e3-0948fafeaa08 req-d5a599e6-986f-4129-be51-22d0dfff9fe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e", "name": "network-vif-deleted", "tag": "e5e295e9-435a-4123-809f-d35762180f58"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:00:49.192971 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-66f652ea-8910-42df-88e3-0948fafeaa08 req-d5a599e6-986f-4129-be51-22d0dfff9fe8 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:49.193852 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-66f652ea-8910-42df-88e3-0948fafeaa08 req-d5a599e6-986f-4129-be51-22d0dfff9fe8 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:49.206937 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-66f652ea-8910-42df-88e3-0948fafeaa08 req-d5a599e6-986f-4129-be51-22d0dfff9fe8 service nova] Creating event network-vif-deleted:e5e295e9-435a-4123-809f-d35762180f58 for instance 99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e on hv-cinder-79760 Jun 03 10:00:49.207585 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-3212699e-cfe1-4e61-9fbd-e266cf449a34 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:49.219266 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-3212699e-cfe1-4e61-9fbd-e266cf449a34 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:49.221258 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-66f652ea-8910-42df-88e3-0948fafeaa08 req-d5a599e6-986f-4129-be51-22d0dfff9fe8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043307 Jun 03 10:00:49.221357 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-3212699e-cfe1-4e61-9fbd-e266cf449a34 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:49.221986 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 236/507] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:00:49.222469 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-3212699e-cfe1-4e61-9fbd-e266cf449a34 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1721 microversion: 2.20 time: 0.323123 Jun 03 10:00:49.235113 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 272/508] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:48 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1721 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:49.384647 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-a249d140-5858-49bb-8389-c0b59847ff72 req-0259bf82-e30c-4cba-990f-552594c4ee3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ecad1bf-3c89-4b29-a511-6e3d71a834fc", "tag": "9e1af8da-841e-40c5-97a6-85870409a32f"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:00:49.394027 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-a249d140-5858-49bb-8389-c0b59847ff72 req-0259bf82-e30c-4cba-990f-552594c4ee3a service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:49.394730 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-a249d140-5858-49bb-8389-c0b59847ff72 req-0259bf82-e30c-4cba-990f-552594c4ee3a service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:49.407941 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-a249d140-5858-49bb-8389-c0b59847ff72 req-0259bf82-e30c-4cba-990f-552594c4ee3a service nova] Creating event network-changed:9e1af8da-841e-40c5-97a6-85870409a32f for instance 2ecad1bf-3c89-4b29-a511-6e3d71a834fc on hv-cinder-79760 Jun 03 10:00:49.414318 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-a249d140-5858-49bb-8389-c0b59847ff72 req-0259bf82-e30c-4cba-990f-552594c4ee3a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033509 Jun 03 10:00:49.415148 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 237/509] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:00:49.501648 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-17d4a634-71ca-4d0f-87c8-ed4b34829c63 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:49.505541 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-17d4a634-71ca-4d0f-87c8-ed4b34829c63 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] [instance: 99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:49.519431 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-17d4a634-71ca-4d0f-87c8-ed4b34829c63 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:49.520272 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-17d4a634-71ca-4d0f-87c8-ed4b34829c63 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:49.521885 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-17d4a634-71ca-4d0f-87c8-ed4b34829c63 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:49.522402 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-17d4a634-71ca-4d0f-87c8-ed4b34829c63 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:49.611542 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-17d4a634-71ca-4d0f-87c8-ed4b34829c63 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5cf34288d4ee46bcb04347985ebf2fa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa11acd38ae14aeea91a05c97b166960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:49.621496 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-17d4a634-71ca-4d0f-87c8-ed4b34829c63 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] 10.222.0.45 "GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e" status: 200 len: 1429 microversion: 2.1 time: 0.137528 Jun 03 10:00:49.631228 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 273/510] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:49 2022] GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e => generated 1429 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:00:50.242168 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-0b509901-3f41-4110-b5aa-04231cd3a681 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:50.242990 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-0b509901-3f41-4110-b5aa-04231cd3a681 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:50.250350 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0b509901-3f41-4110-b5aa-04231cd3a681 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:50.251205 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0b509901-3f41-4110-b5aa-04231cd3a681 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:50.252069 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0b509901-3f41-4110-b5aa-04231cd3a681 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:50.252600 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0b509901-3f41-4110-b5aa-04231cd3a681 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:50.452213 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-0b509901-3f41-4110-b5aa-04231cd3a681 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:50.467610 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-0b509901-3f41-4110-b5aa-04231cd3a681 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:50.469380 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-0b509901-3f41-4110-b5aa-04231cd3a681 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:50.470630 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-0b509901-3f41-4110-b5aa-04231cd3a681 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1721 microversion: 2.20 time: 0.233255 Jun 03 10:00:50.481908 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 238/511] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:50 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1721 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:50.640220 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-76028ed2-95a1-431c-8935-0240a8172491 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:50.642280 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-76028ed2-95a1-431c-8935-0240a8172491 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] [instance: 99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:50.651120 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-76028ed2-95a1-431c-8935-0240a8172491 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:50.651581 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-76028ed2-95a1-431c-8935-0240a8172491 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:50.652570 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-76028ed2-95a1-431c-8935-0240a8172491 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:50.653176 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-76028ed2-95a1-431c-8935-0240a8172491 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:50.672324 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.wsgi [None req-76028ed2-95a1-431c-8935-0240a8172491 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] HTTP exception thrown: Instance 99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e could not be found. Jun 03 10:00:50.674245 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-76028ed2-95a1-431c-8935-0240a8172491 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Request method failure captured: Jun 03 10:00:50.674245 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: request: GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e HTTP/1.1 Jun 03 10:00:50.674245 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Accept: application/json Jun 03 10:00:50.674245 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Accept-Encoding: identity Jun 03 10:00:50.674245 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Connection: close Jun 03 10:00:50.674245 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Content-Length: 0 Jun 03 10:00:50.674245 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Content-Type: application/json Jun 03 10:00:50.674245 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Host: 10.222.0.45 Jun 03 10:00:50.674245 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Openstack-System-Scope: None Jun 03 10:00:50.674245 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: User-Agent: python-urllib3/1.26.9 Jun 03 10:00:50.674245 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Auth-Token: gAAAAABimdumBMKWWYX2Fb4K-cqubh7nb1YXaiTMXjCsCjY5tccUZ7xGWAH2AkDqYOaQqgwIrM1QZfRVUt6V8IGd3mJuZ2uFjHQp5bY5BlJE0fbHgOkOuPFBErZaS-IN0tprt8lmd8xU7WM1LrXRHjpyFo7PiNGH4DLWI_wP8PCAztVJ24chBRY Jun 03 10:00:50.674245 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Domain-Id: None Jun 03 10:00:50.674245 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Domain-Name: None Jun 03 10:00:50.674245 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Identity-Status: Confirmed Jun 03 10:00:50.674245 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Is-Admin-Project: True Jun 03 10:00:50.674245 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Domain-Id: default Jun 03 10:00:50.674245 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Domain-Name: Default Jun 03 10:00:50.674245 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Id: aa11acd38ae14aeea91a05c97b166960 Jun 03 10:00:50.674245 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Name: tempest-VolumesNegativeTest-1623492742 Jun 03 10:00:50.674245 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Role: member,reader Jun 03 10:00:50.674245 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Roles: member,reader Jun 03 10:00:50.675618 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_aa11acd38ae14aeea91a05c97b166960", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/aa11acd38ae14aeea91a05c97b166960"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/aa11acd38ae14aeea91a05c97b166960"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/aa11acd38ae14aeea91a05c97b166960"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 10:00:50.675618 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant: tempest-VolumesNegativeTest-1623492742 Jun 03 10:00:50.675618 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant-Id: aa11acd38ae14aeea91a05c97b166960 Jun 03 10:00:50.675618 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant-Name: tempest-VolumesNegativeTest-1623492742 Jun 03 10:00:50.675618 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User: tempest-VolumesNegativeTest-1623492742-project Jun 03 10:00:50.675618 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Domain-Id: default Jun 03 10:00:50.675618 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Domain-Name: Default Jun 03 10:00:50.675618 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Id: 5cf34288d4ee46bcb04347985ebf2fa7 Jun 03 10:00:50.675618 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Name: tempest-VolumesNegativeTest-1623492742-project Jun 03 10:00:50.675618 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: method: > Jun 03 10:00:50.675618 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: exception: Instance 99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e could not be found. Jun 03 10:00:50.675618 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: action_args: {'id': '99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e'} Jun 03 10:00:50.676380 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:00:50.676380 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:00:50.676380 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:00:50.676380 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:00:50.676380 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:00:50.676380 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:00:50.676380 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:00:50.676380 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:00:50.676380 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:00:50.676380 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:00:50.676380 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e could not be found. Jun 03 10:00:50.676380 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:00:50.676380 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:00:50.676380 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:00:50.676380 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:00:50.676380 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:00:50.676380 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:00:50.676380 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:00:50.676380 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:00:50.676380 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:00:50.678509 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:00:50.678509 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:00:50.678509 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:00:50.678509 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:00:50.678509 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:00:50.678509 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:00:50.678509 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:00:50.678509 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e could not be found. Jun 03 10:00:50.678509 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:00:50.678509 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:00:50.678509 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:00:50.678509 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:00:50.678509 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:00:50.678509 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:00:50.678509 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:00:50.678509 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:00:50.678509 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e could not be found. Jun 03 10:00:50.678509 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:00:50.680020 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-76028ed2-95a1-431c-8935-0240a8172491 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] Returning 404 to user: Instance 99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e could not be found. {{(pid=117647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:00:50.680020 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-76028ed2-95a1-431c-8935-0240a8172491 tempest-VolumesNegativeTest-1623492742 tempest-VolumesNegativeTest-1623492742-project] 10.222.0.45 "GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e" status: 404 len: 111 microversion: 2.1 time: 0.041508 Jun 03 10:00:50.680020 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 274/512] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:50 2022] GET /compute/v2.1/servers/99b6cde0-a9ce-4635-a7ea-3f0ac83b4a9e => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 10:00:51.245023 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-08911d87-79d5-4d3a-b4f2-c2ba7aa7e467 req-d2f9781c-46c4-48b4-83ca-4b54799f3421 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f", "name": "network-vif-unplugged", "status": "completed", "tag": "d6b08e27-3091-4087-a29a-03ef6cbbdc0a"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:00:51.258579 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-08911d87-79d5-4d3a-b4f2-c2ba7aa7e467 req-d2f9781c-46c4-48b4-83ca-4b54799f3421 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:51.263430 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-08911d87-79d5-4d3a-b4f2-c2ba7aa7e467 req-d2f9781c-46c4-48b4-83ca-4b54799f3421 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:51.286366 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-08911d87-79d5-4d3a-b4f2-c2ba7aa7e467 req-d2f9781c-46c4-48b4-83ca-4b54799f3421 service nova] Creating event network-vif-unplugged:d6b08e27-3091-4087-a29a-03ef6cbbdc0a for instance 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f on hv-cinder-79760 Jun 03 10:00:51.291901 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-08911d87-79d5-4d3a-b4f2-c2ba7aa7e467 req-d2f9781c-46c4-48b4-83ca-4b54799f3421 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054342 Jun 03 10:00:51.293205 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 239/513] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:00:51.489063 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-1bbec997-d224-49b1-b3aa-360c8f55b314 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:51.489686 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-1bbec997-d224-49b1-b3aa-360c8f55b314 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:51.499611 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1bbec997-d224-49b1-b3aa-360c8f55b314 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:51.505371 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1bbec997-d224-49b1-b3aa-360c8f55b314 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:51.506301 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1bbec997-d224-49b1-b3aa-360c8f55b314 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:51.507207 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1bbec997-d224-49b1-b3aa-360c8f55b314 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:51.685672 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-1bbec997-d224-49b1-b3aa-360c8f55b314 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:51.695266 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-1bbec997-d224-49b1-b3aa-360c8f55b314 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:51.701391 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-1bbec997-d224-49b1-b3aa-360c8f55b314 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:51.702748 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-1bbec997-d224-49b1-b3aa-360c8f55b314 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1721 microversion: 2.20 time: 0.218232 Jun 03 10:00:51.710493 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 275/514] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:51 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1721 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:52.730191 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-978880c9-bd0c-4294-acb1-52a296c7ea38 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:52.731505 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-978880c9-bd0c-4294-acb1-52a296c7ea38 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:52.748700 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-978880c9-bd0c-4294-acb1-52a296c7ea38 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:52.749200 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-978880c9-bd0c-4294-acb1-52a296c7ea38 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:52.750516 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-978880c9-bd0c-4294-acb1-52a296c7ea38 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:52.751124 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-978880c9-bd0c-4294-acb1-52a296c7ea38 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:52.918146 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-978880c9-bd0c-4294-acb1-52a296c7ea38 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:52.927492 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-978880c9-bd0c-4294-acb1-52a296c7ea38 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:52.928837 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-978880c9-bd0c-4294-acb1-52a296c7ea38 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:52.930226 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-978880c9-bd0c-4294-acb1-52a296c7ea38 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1721 microversion: 2.20 time: 0.205380 Jun 03 10:00:52.930783 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 240/515] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:52 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1721 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:53.950218 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-8ca53c58-9522-43cb-b09a-a74dd1cc3918 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:53.950881 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-8ca53c58-9522-43cb-b09a-a74dd1cc3918 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:53.957362 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8ca53c58-9522-43cb-b09a-a74dd1cc3918 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:53.957838 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8ca53c58-9522-43cb-b09a-a74dd1cc3918 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:53.958622 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8ca53c58-9522-43cb-b09a-a74dd1cc3918 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:53.959079 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8ca53c58-9522-43cb-b09a-a74dd1cc3918 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:54.093653 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-8ca53c58-9522-43cb-b09a-a74dd1cc3918 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:54.101974 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-8ca53c58-9522-43cb-b09a-a74dd1cc3918 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:54.103762 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-8ca53c58-9522-43cb-b09a-a74dd1cc3918 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:54.104938 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-8ca53c58-9522-43cb-b09a-a74dd1cc3918 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1721 microversion: 2.20 time: 0.158990 Jun 03 10:00:54.105477 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 276/516] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:53 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:55.124647 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-f5e24ef5-1202-4b80-8e75-b7dcff8ef76c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:55.125936 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-f5e24ef5-1202-4b80-8e75-b7dcff8ef76c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:55.137250 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f5e24ef5-1202-4b80-8e75-b7dcff8ef76c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:55.137896 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f5e24ef5-1202-4b80-8e75-b7dcff8ef76c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:55.139444 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f5e24ef5-1202-4b80-8e75-b7dcff8ef76c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:55.140176 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f5e24ef5-1202-4b80-8e75-b7dcff8ef76c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:55.314852 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f5e24ef5-1202-4b80-8e75-b7dcff8ef76c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:55.323775 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f5e24ef5-1202-4b80-8e75-b7dcff8ef76c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:55.325590 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f5e24ef5-1202-4b80-8e75-b7dcff8ef76c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:55.326900 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-f5e24ef5-1202-4b80-8e75-b7dcff8ef76c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1664 microversion: 2.20 time: 0.207426 Jun 03 10:00:55.327679 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 241/517] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:55 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1664 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 10:00:55.345486 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-6e7e0b79-c46e-4f62-a82b-d22a44a6292e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8df22a00-8205-4799-9bd0-86e00c4c8678"}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:00:55.347186 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-6e7e0b79-c46e-4f62-a82b-d22a44a6292e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:55.354050 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6e7e0b79-c46e-4f62-a82b-d22a44a6292e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:55.354732 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6e7e0b79-c46e-4f62-a82b-d22a44a6292e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:55.355822 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6e7e0b79-c46e-4f62-a82b-d22a44a6292e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:55.356502 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6e7e0b79-c46e-4f62-a82b-d22a44a6292e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:55.757363 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-6e7e0b79-c46e-4f62-a82b-d22a44a6292e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "POST /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.416150 Jun 03 10:00:55.758017 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 277/518] 10.222.0.45 () {62 vars in 1363 bytes} [Fri Jun 3 10:00:55 2022] POST /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f/os-volume_attachments => generated 188 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 10:00:55.889718 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-99978d9a-c45b-45a1-8dfc-694a3cb0ba7a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:00:55.890371 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-99978d9a-c45b-45a1-8dfc-694a3cb0ba7a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:55.896864 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-99978d9a-c45b-45a1-8dfc-694a3cb0ba7a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:55.897321 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-99978d9a-c45b-45a1-8dfc-694a3cb0ba7a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:55.898164 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-99978d9a-c45b-45a1-8dfc-694a3cb0ba7a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:55.898609 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-99978d9a-c45b-45a1-8dfc-694a3cb0ba7a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:55.996313 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-99978d9a-c45b-45a1-8dfc-694a3cb0ba7a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "POST /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f/action" status: 202 len: 0 microversion: 2.20 time: 0.110678 Jun 03 10:00:55.996983 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 242/519] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jun 3 10:00:55 2022] POST /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 03 10:00:56.005017 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-af3b07de-876b-4af9-84b2-cf4c42cfe2b6 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:56.005590 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-af3b07de-876b-4af9-84b2-cf4c42cfe2b6 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:56.012122 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-af3b07de-876b-4af9-84b2-cf4c42cfe2b6 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:56.012566 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-af3b07de-876b-4af9-84b2-cf4c42cfe2b6 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:56.013323 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-af3b07de-876b-4af9-84b2-cf4c42cfe2b6 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:56.013774 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-af3b07de-876b-4af9-84b2-cf4c42cfe2b6 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:56.152560 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-af3b07de-876b-4af9-84b2-cf4c42cfe2b6 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:56.161990 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-af3b07de-876b-4af9-84b2-cf4c42cfe2b6 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:56.163487 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-af3b07de-876b-4af9-84b2-cf4c42cfe2b6 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:56.164676 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-af3b07de-876b-4af9-84b2-cf4c42cfe2b6 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1750 microversion: 2.20 time: 0.163600 Jun 03 10:00:56.165240 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 278/520] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:56 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1750 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 10:00:57.182838 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-50644259-496a-401c-9d07-87a7166623e5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:57.183450 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-50644259-496a-401c-9d07-87a7166623e5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:57.190824 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-50644259-496a-401c-9d07-87a7166623e5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:57.191280 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-50644259-496a-401c-9d07-87a7166623e5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:57.192043 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-50644259-496a-401c-9d07-87a7166623e5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:57.192482 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-50644259-496a-401c-9d07-87a7166623e5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:57.332937 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-50644259-496a-401c-9d07-87a7166623e5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:57.341297 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-50644259-496a-401c-9d07-87a7166623e5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:57.342825 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-50644259-496a-401c-9d07-87a7166623e5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:57.344529 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-50644259-496a-401c-9d07-87a7166623e5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1752 microversion: 2.20 time: 0.165719 Jun 03 10:00:57.345087 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 243/521] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:57 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1752 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:58.362942 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-5c7e3fde-eef7-4933-bb77-bb6ca627cda9 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:58.363887 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-5c7e3fde-eef7-4933-bb77-bb6ca627cda9 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:58.370153 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5c7e3fde-eef7-4933-bb77-bb6ca627cda9 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:58.370593 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5c7e3fde-eef7-4933-bb77-bb6ca627cda9 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:58.371353 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5c7e3fde-eef7-4933-bb77-bb6ca627cda9 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:58.371788 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5c7e3fde-eef7-4933-bb77-bb6ca627cda9 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:58.512197 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-5c7e3fde-eef7-4933-bb77-bb6ca627cda9 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:58.521672 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-5c7e3fde-eef7-4933-bb77-bb6ca627cda9 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:58.523213 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-5c7e3fde-eef7-4933-bb77-bb6ca627cda9 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:58.524520 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-5c7e3fde-eef7-4933-bb77-bb6ca627cda9 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1752 microversion: 2.20 time: 0.165512 Jun 03 10:00:58.525284 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 279/522] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:58 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1752 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:00:59.342769 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-fbe76cf6-ade9-456b-9647-9d683e9df0ef tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:00:59.343791 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-fbe76cf6-ade9-456b-9647-9d683e9df0ef tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:59.346236 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell0:SELECT=4 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:00:59.351785 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fbe76cf6-ade9-456b-9647-9d683e9df0ef tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:59.352243 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fbe76cf6-ade9-456b-9647-9d683e9df0ef tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:59.353050 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fbe76cf6-ade9-456b-9647-9d683e9df0ef tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:59.353545 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fbe76cf6-ade9-456b-9647-9d683e9df0ef tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:59.429943 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-fbe76cf6-ade9-456b-9647-9d683e9df0ef tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "POST /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f/action" status: 202 len: 0 microversion: 2.1 time: 0.090863 Jun 03 10:00:59.430566 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 244/523] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jun 3 10:00:59 2022] POST /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 10:00:59.439253 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-ae4d36c8-3f77-4180-84ab-8b33fe461ede tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:59.440710 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-ae4d36c8-3f77-4180-84ab-8b33fe461ede tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:59.448124 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ae4d36c8-3f77-4180-84ab-8b33fe461ede tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:59.448580 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ae4d36c8-3f77-4180-84ab-8b33fe461ede tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:59.449391 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ae4d36c8-3f77-4180-84ab-8b33fe461ede tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:59.449859 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ae4d36c8-3f77-4180-84ab-8b33fe461ede tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:59.543807 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-d3217b2b-e101-447f-83c8-22752f5af276 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:00:59.544574 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-d3217b2b-e101-447f-83c8-22752f5af276 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:00:59.550942 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d3217b2b-e101-447f-83c8-22752f5af276 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:59.551462 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d3217b2b-e101-447f-83c8-22752f5af276 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:59.552329 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d3217b2b-e101-447f-83c8-22752f5af276 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:00:59.552841 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d3217b2b-e101-447f-83c8-22752f5af276 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:00:59.647058 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-ae4d36c8-3f77-4180-84ab-8b33fe461ede tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:59.659163 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-ae4d36c8-3f77-4180-84ab-8b33fe461ede tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1748 microversion: 2.1 time: 0.223650 Jun 03 10:00:59.659974 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 280/524] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:00:59 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1748 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:00:59.715665 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d3217b2b-e101-447f-83c8-22752f5af276 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:59.724313 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d3217b2b-e101-447f-83c8-22752f5af276 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:59.725877 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d3217b2b-e101-447f-83c8-22752f5af276 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:00:59.727051 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-d3217b2b-e101-447f-83c8-22752f5af276 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1808 microversion: 2.20 time: 0.187841 Jun 03 10:00:59.727713 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 245/525] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:00:59 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:00.678967 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-489e64e1-43ac-460e-9b31-d20ebc2c8e89 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:00.678967 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-489e64e1-43ac-460e-9b31-d20ebc2c8e89 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:00.700277 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-489e64e1-43ac-460e-9b31-d20ebc2c8e89 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:00.700738 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-489e64e1-43ac-460e-9b31-d20ebc2c8e89 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:00.701546 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-489e64e1-43ac-460e-9b31-d20ebc2c8e89 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:00.702010 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-489e64e1-43ac-460e-9b31-d20ebc2c8e89 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:00.744350 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-e535477d-26b7-4afb-a1de-316c651612d1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:00.744957 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-e535477d-26b7-4afb-a1de-316c651612d1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:00.752758 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e535477d-26b7-4afb-a1de-316c651612d1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:00.753436 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e535477d-26b7-4afb-a1de-316c651612d1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:00.754446 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e535477d-26b7-4afb-a1de-316c651612d1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:00.754921 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e535477d-26b7-4afb-a1de-316c651612d1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:00.936828 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-489e64e1-43ac-460e-9b31-d20ebc2c8e89 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:00.945162 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-489e64e1-43ac-460e-9b31-d20ebc2c8e89 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1753 microversion: 2.1 time: 0.271766 Jun 03 10:01:00.945847 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 281/526] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:00 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1753 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:01:00.959046 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-e535477d-26b7-4afb-a1de-316c651612d1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:00.968069 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-e535477d-26b7-4afb-a1de-316c651612d1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:00.970517 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-e535477d-26b7-4afb-a1de-316c651612d1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:00.971748 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-e535477d-26b7-4afb-a1de-316c651612d1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1808 microversion: 2.20 time: 0.231282 Jun 03 10:01:00.972369 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 246/527] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:00 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1808 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:01.962922 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-d59a4133-78b4-4d8e-a7ae-3ef2227929a4 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:01.963540 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-d59a4133-78b4-4d8e-a7ae-3ef2227929a4 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:01.970901 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d59a4133-78b4-4d8e-a7ae-3ef2227929a4 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:01.971360 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d59a4133-78b4-4d8e-a7ae-3ef2227929a4 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:01.972140 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d59a4133-78b4-4d8e-a7ae-3ef2227929a4 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:01.972586 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d59a4133-78b4-4d8e-a7ae-3ef2227929a4 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:01.992239 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-eb795dd6-1b6b-4d9f-ac54-1c24e977aa9d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:01.993432 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-eb795dd6-1b6b-4d9f-ac54-1c24e977aa9d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:02.000318 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-eb795dd6-1b6b-4d9f-ac54-1c24e977aa9d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:02.001301 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-eb795dd6-1b6b-4d9f-ac54-1c24e977aa9d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:02.002116 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-eb795dd6-1b6b-4d9f-ac54-1c24e977aa9d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:02.002559 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-eb795dd6-1b6b-4d9f-ac54-1c24e977aa9d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:02.197880 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-eb795dd6-1b6b-4d9f-ac54-1c24e977aa9d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:02.200292 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:01:02.216756 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-d59a4133-78b4-4d8e-a7ae-3ef2227929a4 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:02.220589 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-eb795dd6-1b6b-4d9f-ac54-1c24e977aa9d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:02.222136 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-eb795dd6-1b6b-4d9f-ac54-1c24e977aa9d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:02.223308 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-eb795dd6-1b6b-4d9f-ac54-1c24e977aa9d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1808 microversion: 2.20 time: 0.235043 Jun 03 10:01:02.224047 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 247/528] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:01 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1808 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:02.225271 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-d59a4133-78b4-4d8e-a7ae-3ef2227929a4 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1753 microversion: 2.1 time: 0.266110 Jun 03 10:01:02.225863 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 282/529] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:01 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1753 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:03.243477 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-e754bdad-fa3a-4207-a3e9-2b87b00dcc08 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:03.244029 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-0be9cded-6cde-4a0c-b776-b08cb093915a tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:03.244409 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-e754bdad-fa3a-4207-a3e9-2b87b00dcc08 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:03.245082 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-0be9cded-6cde-4a0c-b776-b08cb093915a tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:03.256099 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e754bdad-fa3a-4207-a3e9-2b87b00dcc08 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:03.256564 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e754bdad-fa3a-4207-a3e9-2b87b00dcc08 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:03.257365 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e754bdad-fa3a-4207-a3e9-2b87b00dcc08 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:03.257836 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e754bdad-fa3a-4207-a3e9-2b87b00dcc08 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:03.260335 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0be9cded-6cde-4a0c-b776-b08cb093915a tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:03.260780 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0be9cded-6cde-4a0c-b776-b08cb093915a tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:03.261543 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0be9cded-6cde-4a0c-b776-b08cb093915a tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:03.262000 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0be9cded-6cde-4a0c-b776-b08cb093915a tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:03.479368 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-e754bdad-fa3a-4207-a3e9-2b87b00dcc08 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:03.485787 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-0be9cded-6cde-4a0c-b776-b08cb093915a tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:03.489175 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-e754bdad-fa3a-4207-a3e9-2b87b00dcc08 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:03.489431 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:01:03.490625 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-e754bdad-fa3a-4207-a3e9-2b87b00dcc08 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:03.491943 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-e754bdad-fa3a-4207-a3e9-2b87b00dcc08 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1808 microversion: 2.20 time: 0.252363 Jun 03 10:01:03.492602 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 248/530] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:03 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1808 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:03.495096 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-0be9cded-6cde-4a0c-b776-b08cb093915a tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1753 microversion: 2.1 time: 0.255316 Jun 03 10:01:03.495619 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 283/531] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:03 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1753 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:01:04.510551 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-22c7e8e9-b65b-4283-aad6-46040220b649 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:04.511180 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-22c7e8e9-b65b-4283-aad6-46040220b649 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:04.514434 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-52b66dd3-b77c-483c-9141-0ed302d69387 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:04.515087 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-52b66dd3-b77c-483c-9141-0ed302d69387 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:04.518273 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-22c7e8e9-b65b-4283-aad6-46040220b649 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:04.518723 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-22c7e8e9-b65b-4283-aad6-46040220b649 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:04.519493 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-22c7e8e9-b65b-4283-aad6-46040220b649 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:04.519926 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-22c7e8e9-b65b-4283-aad6-46040220b649 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:04.523645 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-52b66dd3-b77c-483c-9141-0ed302d69387 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:04.524146 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-52b66dd3-b77c-483c-9141-0ed302d69387 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:04.524930 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-52b66dd3-b77c-483c-9141-0ed302d69387 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:04.525372 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-52b66dd3-b77c-483c-9141-0ed302d69387 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:04.721147 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-22c7e8e9-b65b-4283-aad6-46040220b649 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:04.731100 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-22c7e8e9-b65b-4283-aad6-46040220b649 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:04.732618 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-22c7e8e9-b65b-4283-aad6-46040220b649 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:04.733833 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-22c7e8e9-b65b-4283-aad6-46040220b649 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1808 microversion: 2.20 time: 0.227411 Jun 03 10:01:04.734954 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 249/532] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:04 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1808 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:04.740079 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-52b66dd3-b77c-483c-9141-0ed302d69387 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:04.748772 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-52b66dd3-b77c-483c-9141-0ed302d69387 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1753 microversion: 2.1 time: 0.240077 Jun 03 10:01:04.749667 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 284/533] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:04 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1753 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:01:05.753300 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-b4b94796-e3da-449f-9eda-fcc6e37948a0 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:05.754287 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-b4b94796-e3da-449f-9eda-fcc6e37948a0 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:05.762066 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b4b94796-e3da-449f-9eda-fcc6e37948a0 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:05.762603 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b4b94796-e3da-449f-9eda-fcc6e37948a0 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:05.763460 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b4b94796-e3da-449f-9eda-fcc6e37948a0 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:05.763961 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b4b94796-e3da-449f-9eda-fcc6e37948a0 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:05.767294 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-2b18c2ec-b8bc-4389-a5d4-ba3d10595dd5 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:05.767901 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-2b18c2ec-b8bc-4389-a5d4-ba3d10595dd5 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:05.774313 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2b18c2ec-b8bc-4389-a5d4-ba3d10595dd5 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:05.774755 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2b18c2ec-b8bc-4389-a5d4-ba3d10595dd5 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:05.775509 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2b18c2ec-b8bc-4389-a5d4-ba3d10595dd5 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:05.775944 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2b18c2ec-b8bc-4389-a5d4-ba3d10595dd5 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:05.972077 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-b4b94796-e3da-449f-9eda-fcc6e37948a0 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:05.989284 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-b4b94796-e3da-449f-9eda-fcc6e37948a0 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:05.992488 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-b4b94796-e3da-449f-9eda-fcc6e37948a0 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:05.993945 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-2b18c2ec-b8bc-4389-a5d4-ba3d10595dd5 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:05.996984 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-b4b94796-e3da-449f-9eda-fcc6e37948a0 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1808 microversion: 2.20 time: 0.244853 Jun 03 10:01:05.997676 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 250/534] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:05 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1808 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:06.009494 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-2b18c2ec-b8bc-4389-a5d4-ba3d10595dd5 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1753 microversion: 2.1 time: 0.246294 Jun 03 10:01:06.010133 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 285/535] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:05 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1753 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:01:07.018001 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-d495eabc-97d9-49a5-bdf9-e2c34a300a3f tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:07.018603 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-d495eabc-97d9-49a5-bdf9-e2c34a300a3f tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:07.025288 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d495eabc-97d9-49a5-bdf9-e2c34a300a3f tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:07.025790 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d495eabc-97d9-49a5-bdf9-e2c34a300a3f tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:07.026666 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d495eabc-97d9-49a5-bdf9-e2c34a300a3f tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:07.026996 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d495eabc-97d9-49a5-bdf9-e2c34a300a3f tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:07.028111 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-bd7f7c7c-5bfb-41cc-be0a-f6d3079384da tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:07.028916 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-bd7f7c7c-5bfb-41cc-be0a-f6d3079384da tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:07.036799 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bd7f7c7c-5bfb-41cc-be0a-f6d3079384da tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:07.037205 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bd7f7c7c-5bfb-41cc-be0a-f6d3079384da tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:07.050583 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bd7f7c7c-5bfb-41cc-be0a-f6d3079384da tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:07.051298 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bd7f7c7c-5bfb-41cc-be0a-f6d3079384da tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:07.255331 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d495eabc-97d9-49a5-bdf9-e2c34a300a3f tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:07.264167 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d495eabc-97d9-49a5-bdf9-e2c34a300a3f tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:07.266354 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d495eabc-97d9-49a5-bdf9-e2c34a300a3f tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:07.267561 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-d495eabc-97d9-49a5-bdf9-e2c34a300a3f tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1808 microversion: 2.20 time: 0.255491 Jun 03 10:01:07.268103 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-bd7f7c7c-5bfb-41cc-be0a-f6d3079384da tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:07.268230 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 251/536] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:07 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1808 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:07.276325 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-bd7f7c7c-5bfb-41cc-be0a-f6d3079384da tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1753 microversion: 2.1 time: 0.252721 Jun 03 10:01:07.277229 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 286/537] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:07 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1753 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:01:08.286366 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-38c0dcdf-9d0c-437a-aea3-fe1632dd717e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:08.286980 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-38c0dcdf-9d0c-437a-aea3-fe1632dd717e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:08.293651 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-38c0dcdf-9d0c-437a-aea3-fe1632dd717e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:08.294140 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-38c0dcdf-9d0c-437a-aea3-fe1632dd717e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:08.294726 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-2b5d37ba-45da-4606-bd44-96ca39a95f57 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:08.295190 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-38c0dcdf-9d0c-437a-aea3-fe1632dd717e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:08.295338 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-38c0dcdf-9d0c-437a-aea3-fe1632dd717e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:08.296161 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-2b5d37ba-45da-4606-bd44-96ca39a95f57 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:08.299144 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:01:08.304838 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2b5d37ba-45da-4606-bd44-96ca39a95f57 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:08.305360 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2b5d37ba-45da-4606-bd44-96ca39a95f57 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:08.306185 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2b5d37ba-45da-4606-bd44-96ca39a95f57 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:08.306616 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2b5d37ba-45da-4606-bd44-96ca39a95f57 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:08.516885 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-38c0dcdf-9d0c-437a-aea3-fe1632dd717e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:08.525501 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-38c0dcdf-9d0c-437a-aea3-fe1632dd717e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:08.527123 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-38c0dcdf-9d0c-437a-aea3-fe1632dd717e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:08.528382 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-38c0dcdf-9d0c-437a-aea3-fe1632dd717e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1808 microversion: 2.20 time: 0.246247 Jun 03 10:01:08.529350 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 252/538] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:08 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1808 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:08.531797 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-2b5d37ba-45da-4606-bd44-96ca39a95f57 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:08.540065 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-2b5d37ba-45da-4606-bd44-96ca39a95f57 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1753 microversion: 2.1 time: 0.249531 Jun 03 10:01:08.540621 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 287/539] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:08 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1753 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:01:09.547414 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-bcc58616-655e-435d-ab65-772332ea1390 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:09.548035 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-bcc58616-655e-435d-ab65-772332ea1390 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:09.555012 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-bcc58616-655e-435d-ab65-772332ea1390 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:09.555712 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-bcc58616-655e-435d-ab65-772332ea1390 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:09.556427 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-cc43c75c-0aa3-4c91-bf6c-5eec2d1ac123 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:09.556919 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-bcc58616-655e-435d-ab65-772332ea1390 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:09.557203 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-bcc58616-655e-435d-ab65-772332ea1390 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:09.558160 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-cc43c75c-0aa3-4c91-bf6c-5eec2d1ac123 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:09.566055 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cc43c75c-0aa3-4c91-bf6c-5eec2d1ac123 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:09.566817 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cc43c75c-0aa3-4c91-bf6c-5eec2d1ac123 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:09.568056 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cc43c75c-0aa3-4c91-bf6c-5eec2d1ac123 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:09.568707 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cc43c75c-0aa3-4c91-bf6c-5eec2d1ac123 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:09.772334 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-bcc58616-655e-435d-ab65-772332ea1390 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:09.781161 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-bcc58616-655e-435d-ab65-772332ea1390 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:09.782695 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-bcc58616-655e-435d-ab65-772332ea1390 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:09.784193 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-bcc58616-655e-435d-ab65-772332ea1390 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1808 microversion: 2.20 time: 0.241385 Jun 03 10:01:09.784829 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 253/540] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:09 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1808 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:09.794947 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-cc43c75c-0aa3-4c91-bf6c-5eec2d1ac123 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:09.803584 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-cc43c75c-0aa3-4c91-bf6c-5eec2d1ac123 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1753 microversion: 2.1 time: 0.251057 Jun 03 10:01:09.804154 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 288/541] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:09 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1753 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:01:10.802815 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-25fd2725-9b29-4ad5-81c7-076133756b0f tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:10.803417 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-25fd2725-9b29-4ad5-81c7-076133756b0f tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:10.809913 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-25fd2725-9b29-4ad5-81c7-076133756b0f tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:10.810370 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-25fd2725-9b29-4ad5-81c7-076133756b0f tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:10.811146 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-25fd2725-9b29-4ad5-81c7-076133756b0f tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:10.811589 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-25fd2725-9b29-4ad5-81c7-076133756b0f tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:10.822792 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-268e46fa-a29e-4c8b-8a72-42563f6c500b tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:10.824544 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-268e46fa-a29e-4c8b-8a72-42563f6c500b tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:10.833031 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-268e46fa-a29e-4c8b-8a72-42563f6c500b tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:10.833484 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-268e46fa-a29e-4c8b-8a72-42563f6c500b tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:10.834517 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-268e46fa-a29e-4c8b-8a72-42563f6c500b tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:10.834956 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-268e46fa-a29e-4c8b-8a72-42563f6c500b tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:11.010922 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-25fd2725-9b29-4ad5-81c7-076133756b0f tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:11.020687 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-25fd2725-9b29-4ad5-81c7-076133756b0f tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:11.022199 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-25fd2725-9b29-4ad5-81c7-076133756b0f tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:11.023347 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-25fd2725-9b29-4ad5-81c7-076133756b0f tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1808 microversion: 2.20 time: 0.224667 Jun 03 10:01:11.024090 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 254/542] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:10 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1808 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:11.048462 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-268e46fa-a29e-4c8b-8a72-42563f6c500b tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:11.057095 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-268e46fa-a29e-4c8b-8a72-42563f6c500b tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1753 microversion: 2.1 time: 0.238883 Jun 03 10:01:11.058133 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 289/543] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:10 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1753 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:12.043520 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-2dd7d41f-ce44-4e41-9c76-28d859bcf00c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:12.044147 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-2dd7d41f-ce44-4e41-9c76-28d859bcf00c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:12.051435 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2dd7d41f-ce44-4e41-9c76-28d859bcf00c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:12.051881 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2dd7d41f-ce44-4e41-9c76-28d859bcf00c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:12.052641 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2dd7d41f-ce44-4e41-9c76-28d859bcf00c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:12.053249 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2dd7d41f-ce44-4e41-9c76-28d859bcf00c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:12.074999 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-64a4d91c-0b30-4a09-85cb-03c4d2303e8b tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:12.075645 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-64a4d91c-0b30-4a09-85cb-03c4d2303e8b tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:12.082386 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-64a4d91c-0b30-4a09-85cb-03c4d2303e8b tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:12.082844 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-64a4d91c-0b30-4a09-85cb-03c4d2303e8b tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:12.083614 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-64a4d91c-0b30-4a09-85cb-03c4d2303e8b tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:12.084047 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-64a4d91c-0b30-4a09-85cb-03c4d2303e8b tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:12.250075 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-2dd7d41f-ce44-4e41-9c76-28d859bcf00c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:12.259628 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-2dd7d41f-ce44-4e41-9c76-28d859bcf00c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:12.261284 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-2dd7d41f-ce44-4e41-9c76-28d859bcf00c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:12.262569 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-2dd7d41f-ce44-4e41-9c76-28d859bcf00c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1808 microversion: 2.20 time: 0.222939 Jun 03 10:01:12.263231 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 255/544] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:12 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1808 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:12.292560 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-64a4d91c-0b30-4a09-85cb-03c4d2303e8b tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:12.315646 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-64a4d91c-0b30-4a09-85cb-03c4d2303e8b tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1753 microversion: 2.1 time: 0.243281 Jun 03 10:01:12.316533 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 290/545] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:12 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1753 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:01:13.281528 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-a21916a5-f441-4b74-92b6-61550ba79164 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:13.282288 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-a21916a5-f441-4b74-92b6-61550ba79164 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:13.288809 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a21916a5-f441-4b74-92b6-61550ba79164 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:13.289265 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a21916a5-f441-4b74-92b6-61550ba79164 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:13.290067 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a21916a5-f441-4b74-92b6-61550ba79164 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:13.290504 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a21916a5-f441-4b74-92b6-61550ba79164 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:13.355139 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-12baa63a-c0cf-4808-9c6e-55ce89c0e0a2 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:13.355139 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-12baa63a-c0cf-4808-9c6e-55ce89c0e0a2 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:13.363706 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-12baa63a-c0cf-4808-9c6e-55ce89c0e0a2 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:13.364165 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-12baa63a-c0cf-4808-9c6e-55ce89c0e0a2 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:13.364960 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-12baa63a-c0cf-4808-9c6e-55ce89c0e0a2 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:13.365390 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-12baa63a-c0cf-4808-9c6e-55ce89c0e0a2 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:13.467043 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-a21916a5-f441-4b74-92b6-61550ba79164 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:13.475532 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-a21916a5-f441-4b74-92b6-61550ba79164 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:13.477037 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-a21916a5-f441-4b74-92b6-61550ba79164 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:13.478214 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-a21916a5-f441-4b74-92b6-61550ba79164 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1808 microversion: 2.20 time: 0.200860 Jun 03 10:01:13.478807 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 256/546] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:13 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1808 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:13.539358 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-12baa63a-c0cf-4808-9c6e-55ce89c0e0a2 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:13.547981 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-12baa63a-c0cf-4808-9c6e-55ce89c0e0a2 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1753 microversion: 2.1 time: 0.208904 Jun 03 10:01:13.548546 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 291/547] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:13 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1753 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:14.496419 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-b29eeb69-9b2c-40dd-b807-e3e21ab98f00 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:14.497003 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-b29eeb69-9b2c-40dd-b807-e3e21ab98f00 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:14.503693 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b29eeb69-9b2c-40dd-b807-e3e21ab98f00 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:14.504132 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b29eeb69-9b2c-40dd-b807-e3e21ab98f00 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:14.504883 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b29eeb69-9b2c-40dd-b807-e3e21ab98f00 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:14.505313 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b29eeb69-9b2c-40dd-b807-e3e21ab98f00 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:14.564750 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-7a1be730-f212-432b-a69a-8a3f14dbe5f5 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:14.565463 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-7a1be730-f212-432b-a69a-8a3f14dbe5f5 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:14.571467 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7a1be730-f212-432b-a69a-8a3f14dbe5f5 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:14.572241 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7a1be730-f212-432b-a69a-8a3f14dbe5f5 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:14.573051 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7a1be730-f212-432b-a69a-8a3f14dbe5f5 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:14.573486 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7a1be730-f212-432b-a69a-8a3f14dbe5f5 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:14.679662 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-b29eeb69-9b2c-40dd-b807-e3e21ab98f00 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:14.689228 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-b29eeb69-9b2c-40dd-b807-e3e21ab98f00 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:14.690772 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-b29eeb69-9b2c-40dd-b807-e3e21ab98f00 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:14.691934 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-b29eeb69-9b2c-40dd-b807-e3e21ab98f00 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1808 microversion: 2.20 time: 0.199468 Jun 03 10:01:14.692916 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 257/548] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:14 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1808 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:14.741847 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-7a1be730-f212-432b-a69a-8a3f14dbe5f5 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:14.749813 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-7a1be730-f212-432b-a69a-8a3f14dbe5f5 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1753 microversion: 2.1 time: 0.189311 Jun 03 10:01:14.750368 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 292/549] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:14 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1753 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:01:15.495809 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-2885db54-6174-447d-b86f-0d6223f1980d tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-861681120", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2036788610", "security_groups": [{"name": "tempest-secgroup-smoke-1041076960"}], "networks": [{"uuid": "d2f477c0-6387-44fc-a497-3f4fc5308a67"}], "block_device_mapping_v2": [{"uuid": "abe63be1-225b-4e76-bab9-0dbe6c4a1191", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:01:15.710203 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-8205d925-d183-403f-b367-36e935719d71 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:15.710810 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-8205d925-d183-403f-b367-36e935719d71 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:15.717505 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8205d925-d183-403f-b367-36e935719d71 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:15.717990 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8205d925-d183-403f-b367-36e935719d71 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:15.718769 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8205d925-d183-403f-b367-36e935719d71 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:15.719210 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8205d925-d183-403f-b367-36e935719d71 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:15.850184 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.network.neutron [None req-2885db54-6174-447d-b86f-0d6223f1980d tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] validate_networks() for [('d2f477c0-6387-44fc-a497-3f4fc5308a67', None, None, None, None, None)] {{(pid=117648) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 10:01:15.949171 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-8205d925-d183-403f-b367-36e935719d71 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:15.957876 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-8205d925-d183-403f-b367-36e935719d71 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:15.959399 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-8205d925-d183-403f-b367-36e935719d71 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:15.960642 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-8205d925-d183-403f-b367-36e935719d71 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1808 microversion: 2.20 time: 0.254317 Jun 03 10:01:15.961146 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 293/550] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:15 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1808 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 10:01:15.965460 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-d397b423-d062-44cf-932e-6ddae253c51f tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:15.966134 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-d397b423-d062-44cf-932e-6ddae253c51f tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:15.972487 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d397b423-d062-44cf-932e-6ddae253c51f tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:15.972944 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d397b423-d062-44cf-932e-6ddae253c51f tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:15.973706 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d397b423-d062-44cf-932e-6ddae253c51f tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:15.974170 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d397b423-d062-44cf-932e-6ddae253c51f tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:16.090243 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:01:16.203209 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-d397b423-d062-44cf-932e-6ddae253c51f tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:16.211432 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-d397b423-d062-44cf-932e-6ddae253c51f tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1753 microversion: 2.1 time: 0.249251 Jun 03 10:01:16.211934 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 294/551] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:15 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1753 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:16.314263 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-2885db54-6174-447d-b86f-0d6223f1980d tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Flavor limits 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 10:01:16.314840 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-2885db54-6174-447d-b86f-0d6223f1980d tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Image limits 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 10:01:16.315310 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-2885db54-6174-447d-b86f-0d6223f1980d tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Flavor pref 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 10:01:16.315766 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-2885db54-6174-447d-b86f-0d6223f1980d tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Image pref 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 10:01:16.316175 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-2885db54-6174-447d-b86f-0d6223f1980d tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 10:01:16.325177 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2885db54-6174-447d-b86f-0d6223f1980d tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:16.325620 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2885db54-6174-447d-b86f-0d6223f1980d tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:16.326467 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2885db54-6174-447d-b86f-0d6223f1980d tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:16.326901 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2885db54-6174-447d-b86f-0d6223f1980d tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:16.344243 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-2885db54-6174-447d-b86f-0d6223f1980d tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Getting quotas for project 475a588bd5a64b508dadf3d93fa5370c. Resources: {'ram', 'cores', 'instances'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 10:01:16.348224 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-2885db54-6174-447d-b86f-0d6223f1980d tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Getting quotas for user 3b1e4b0732d34ec896c84cb52a297447 and project 475a588bd5a64b508dadf3d93fa5370c. Resources: {'ram', 'cores', 'instances'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 10:01:16.403433 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-2885db54-6174-447d-b86f-0d6223f1980d tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Going to run 1 instances... {{(pid=117648) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 10:01:16.405496 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-2885db54-6174-447d-b86f-0d6223f1980d tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='abe63be1-225b-4e76-bab9-0dbe6c4a1191',volume_size=None,volume_type=None)] {{(pid=117648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 10:01:16.532424 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-2885db54-6174-447d-b86f-0d6223f1980d tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.040686 Jun 03 10:01:16.533322 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 258/552] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jun 3 10:01:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 1042 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 10:01:16.543406 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-d196f45e-25c8-4a4f-9b5a-627a30c26367 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:16.544049 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-d196f45e-25c8-4a4f-9b5a-627a30c26367 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:16.596961 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-d196f45e-25c8-4a4f-9b5a-627a30c26367 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:16.603728 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-d196f45e-25c8-4a4f-9b5a-627a30c26367 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1088 microversion: 2.1 time: 0.064096 Jun 03 10:01:16.604288 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 295/553] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:16 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1088 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:16.979332 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-b6c60b4f-94f2-437c-b770-bd586a929463 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:16.979944 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-b6c60b4f-94f2-437c-b770-bd586a929463 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:16.986879 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b6c60b4f-94f2-437c-b770-bd586a929463 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:16.987342 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b6c60b4f-94f2-437c-b770-bd586a929463 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:16.988196 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b6c60b4f-94f2-437c-b770-bd586a929463 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:16.988710 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b6c60b4f-94f2-437c-b770-bd586a929463 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:17.122904 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-b6c60b4f-94f2-437c-b770-bd586a929463 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:17.131926 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-b6c60b4f-94f2-437c-b770-bd586a929463 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:17.133422 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-b6c60b4f-94f2-437c-b770-bd586a929463 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:17.134603 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-b6c60b4f-94f2-437c-b770-bd586a929463 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1808 microversion: 2.20 time: 0.159226 Jun 03 10:01:17.135158 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 259/554] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:16 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:17.228239 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-191ea068-7c5d-419b-b567-ee7e4645ab5e tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:17.228849 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-191ea068-7c5d-419b-b567-ee7e4645ab5e tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:17.236616 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-191ea068-7c5d-419b-b567-ee7e4645ab5e tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:17.237065 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-191ea068-7c5d-419b-b567-ee7e4645ab5e tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:17.237857 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-191ea068-7c5d-419b-b567-ee7e4645ab5e tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:17.238296 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-191ea068-7c5d-419b-b567-ee7e4645ab5e tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:17.378105 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-191ea068-7c5d-419b-b567-ee7e4645ab5e tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:17.386083 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-191ea068-7c5d-419b-b567-ee7e4645ab5e tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1753 microversion: 2.1 time: 0.161603 Jun 03 10:01:17.386651 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 296/555] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:17 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:17.620397 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-1b067c51-0793-48ac-8d74-7ef0f50dfeb9 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:17.620968 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-1b067c51-0793-48ac-8d74-7ef0f50dfeb9 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:17.627517 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1b067c51-0793-48ac-8d74-7ef0f50dfeb9 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:17.627963 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1b067c51-0793-48ac-8d74-7ef0f50dfeb9 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:17.628723 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1b067c51-0793-48ac-8d74-7ef0f50dfeb9 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:17.629156 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1b067c51-0793-48ac-8d74-7ef0f50dfeb9 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:17.691269 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-1b067c51-0793-48ac-8d74-7ef0f50dfeb9 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:17.698773 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-1b067c51-0793-48ac-8d74-7ef0f50dfeb9 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1186 microversion: 2.1 time: 0.082320 Jun 03 10:01:17.699341 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 260/556] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:17 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1186 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:18.152428 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-081b8b39-6761-4437-9e1a-4ad204f1f6c1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:18.153093 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-081b8b39-6761-4437-9e1a-4ad204f1f6c1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:18.160094 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-081b8b39-6761-4437-9e1a-4ad204f1f6c1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:18.160540 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-081b8b39-6761-4437-9e1a-4ad204f1f6c1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:18.161311 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-081b8b39-6761-4437-9e1a-4ad204f1f6c1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:18.161764 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-081b8b39-6761-4437-9e1a-4ad204f1f6c1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:18.293933 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-081b8b39-6761-4437-9e1a-4ad204f1f6c1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:18.302753 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-081b8b39-6761-4437-9e1a-4ad204f1f6c1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:18.304355 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-081b8b39-6761-4437-9e1a-4ad204f1f6c1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:18.305399 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-081b8b39-6761-4437-9e1a-4ad204f1f6c1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1808 microversion: 2.20 time: 0.156874 Jun 03 10:01:18.305992 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 297/557] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:18 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:18.404132 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-d1c08889-7d32-45c6-ac9a-af518a13541e tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:18.410068 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-d1c08889-7d32-45c6-ac9a-af518a13541e tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:18.412887 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-dbcc3831-35e1-4cee-aef6-11ba0d9ce183 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "85398176-4b7b-4cdb-ae84-f80a34a24072"}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:01:18.414081 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-dbcc3831-35e1-4cee-aef6-11ba0d9ce183 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:18.419913 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d1c08889-7d32-45c6-ac9a-af518a13541e tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:18.420471 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d1c08889-7d32-45c6-ac9a-af518a13541e tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:18.420581 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-dbcc3831-35e1-4cee-aef6-11ba0d9ce183 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:18.421040 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-dbcc3831-35e1-4cee-aef6-11ba0d9ce183 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:18.421243 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d1c08889-7d32-45c6-ac9a-af518a13541e tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:18.422054 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-dbcc3831-35e1-4cee-aef6-11ba0d9ce183 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:18.422392 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d1c08889-7d32-45c6-ac9a-af518a13541e tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:18.422646 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-dbcc3831-35e1-4cee-aef6-11ba0d9ce183 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:18.590439 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d1c08889-7d32-45c6-ac9a-af518a13541e tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:18.603674 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-d1c08889-7d32-45c6-ac9a-af518a13541e tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1753 microversion: 2.1 time: 0.203475 Jun 03 10:01:18.604359 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 261/558] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:18 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1753 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:18.716199 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-80e0b660-fc06-4f76-81d7-94c09efb206b tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:18.717017 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-80e0b660-fc06-4f76-81d7-94c09efb206b tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:18.723868 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-80e0b660-fc06-4f76-81d7-94c09efb206b tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:18.724535 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-80e0b660-fc06-4f76-81d7-94c09efb206b tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:18.725693 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-80e0b660-fc06-4f76-81d7-94c09efb206b tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:18.726159 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-80e0b660-fc06-4f76-81d7-94c09efb206b tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:18.772552 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-dbcc3831-35e1-4cee-aef6-11ba0d9ce183 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "POST /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.366356 Jun 03 10:01:18.773882 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 298/559] 10.222.0.45 () {60 vars in 1322 bytes} [Fri Jun 3 10:01:18 2022] POST /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6/os-volume_attachments => generated 194 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:01:18.910514 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-80e0b660-fc06-4f76-81d7-94c09efb206b tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:18.919556 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-80e0b660-fc06-4f76-81d7-94c09efb206b tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1272 microversion: 2.1 time: 0.207745 Jun 03 10:01:18.930657 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 262/560] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:18 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1272 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:01:19.325605 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-a80874d6-b5e2-4404-82f7-144d186b932c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:19.326350 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-a80874d6-b5e2-4404-82f7-144d186b932c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:19.334018 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a80874d6-b5e2-4404-82f7-144d186b932c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:19.334617 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a80874d6-b5e2-4404-82f7-144d186b932c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:19.335544 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a80874d6-b5e2-4404-82f7-144d186b932c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:19.335985 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a80874d6-b5e2-4404-82f7-144d186b932c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:19.384629 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-67e20419-1c2c-4745-ab2b-d263bbb7361d req-55688b3f-32dd-4160-a483-886f670e8940 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a0aa280-d0b4-42e3-8dd4-e222a70d0f10", "tag": "11ea2cd5-6468-4db5-8bec-8a0e6b1acff8"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:01:19.401102 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-67e20419-1c2c-4745-ab2b-d263bbb7361d req-55688b3f-32dd-4160-a483-886f670e8940 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:19.404071 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-67e20419-1c2c-4745-ab2b-d263bbb7361d req-55688b3f-32dd-4160-a483-886f670e8940 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:19.417246 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-67e20419-1c2c-4745-ab2b-d263bbb7361d req-55688b3f-32dd-4160-a483-886f670e8940 service nova] Creating event network-changed:11ea2cd5-6468-4db5-8bec-8a0e6b1acff8 for instance 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 on hv-cinder-79760 Jun 03 10:01:19.423840 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-67e20419-1c2c-4745-ab2b-d263bbb7361d req-55688b3f-32dd-4160-a483-886f670e8940 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056096 Jun 03 10:01:19.424550 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 263/561] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:01:19.484344 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-a80874d6-b5e2-4404-82f7-144d186b932c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:19.493194 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-a80874d6-b5e2-4404-82f7-144d186b932c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:19.506335 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-a80874d6-b5e2-4404-82f7-144d186b932c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:19.507656 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-a80874d6-b5e2-4404-82f7-144d186b932c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1808 microversion: 2.20 time: 0.186789 Jun 03 10:01:19.508247 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 299/562] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:19 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:19.623034 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-8bcf0963-6e4e-4e3f-8933-cd18216f2e4e tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:19.623795 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-8bcf0963-6e4e-4e3f-8933-cd18216f2e4e tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:19.632100 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8bcf0963-6e4e-4e3f-8933-cd18216f2e4e tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:19.632490 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8bcf0963-6e4e-4e3f-8933-cd18216f2e4e tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:19.633260 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8bcf0963-6e4e-4e3f-8933-cd18216f2e4e tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:19.633702 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8bcf0963-6e4e-4e3f-8933-cd18216f2e4e tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:19.786145 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-8bcf0963-6e4e-4e3f-8933-cd18216f2e4e tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:19.794128 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-8bcf0963-6e4e-4e3f-8933-cd18216f2e4e tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1753 microversion: 2.1 time: 0.175355 Jun 03 10:01:19.794699 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 264/563] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:19 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1753 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:19.936197 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-2a6ad1a4-62c8-4137-abc5-2f5066029fb0 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:19.936836 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-2a6ad1a4-62c8-4137-abc5-2f5066029fb0 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:19.943844 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2a6ad1a4-62c8-4137-abc5-2f5066029fb0 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:19.944290 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2a6ad1a4-62c8-4137-abc5-2f5066029fb0 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:19.945046 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2a6ad1a4-62c8-4137-abc5-2f5066029fb0 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:19.945474 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2a6ad1a4-62c8-4137-abc5-2f5066029fb0 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:19.950100 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:01:20.082624 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-2a6ad1a4-62c8-4137-abc5-2f5066029fb0 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:20.090017 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-2a6ad1a4-62c8-4137-abc5-2f5066029fb0 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1260 microversion: 2.1 time: 0.157547 Jun 03 10:01:20.090572 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 300/564] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:19 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:20.527208 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-bfb3cad7-fca0-43d5-9f18-ef59785c0f89 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:20.527800 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-bfb3cad7-fca0-43d5-9f18-ef59785c0f89 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:20.535849 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-bfb3cad7-fca0-43d5-9f18-ef59785c0f89 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:20.536304 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-bfb3cad7-fca0-43d5-9f18-ef59785c0f89 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:20.537089 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-bfb3cad7-fca0-43d5-9f18-ef59785c0f89 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:20.537526 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-bfb3cad7-fca0-43d5-9f18-ef59785c0f89 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:20.670038 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-bfb3cad7-fca0-43d5-9f18-ef59785c0f89 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:20.673007 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell1:SELECT=100 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:01:20.680357 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-bfb3cad7-fca0-43d5-9f18-ef59785c0f89 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:20.681885 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-bfb3cad7-fca0-43d5-9f18-ef59785c0f89 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:20.683053 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-bfb3cad7-fca0-43d5-9f18-ef59785c0f89 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1808 microversion: 2.20 time: 0.159794 Jun 03 10:01:20.683808 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 265/565] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:20 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:20.813150 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-1916bf69-20f0-425b-86f8-5d87b7801e4b tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:20.813798 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-1916bf69-20f0-425b-86f8-5d87b7801e4b tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:20.820428 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1916bf69-20f0-425b-86f8-5d87b7801e4b tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:20.820882 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1916bf69-20f0-425b-86f8-5d87b7801e4b tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:20.821671 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1916bf69-20f0-425b-86f8-5d87b7801e4b tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:20.822238 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1916bf69-20f0-425b-86f8-5d87b7801e4b tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:20.971702 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-1916bf69-20f0-425b-86f8-5d87b7801e4b tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:20.979935 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-1916bf69-20f0-425b-86f8-5d87b7801e4b tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1753 microversion: 2.1 time: 0.170635 Jun 03 10:01:20.980505 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 301/566] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:20 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1753 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:21.106792 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-f88d9e1f-75f9-434b-b093-e10720a6f41b tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:21.107404 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-f88d9e1f-75f9-434b-b093-e10720a6f41b tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:21.113927 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f88d9e1f-75f9-434b-b093-e10720a6f41b tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:21.114378 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f88d9e1f-75f9-434b-b093-e10720a6f41b tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:21.115143 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f88d9e1f-75f9-434b-b093-e10720a6f41b tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:21.115600 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f88d9e1f-75f9-434b-b093-e10720a6f41b tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:21.244788 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f88d9e1f-75f9-434b-b093-e10720a6f41b tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:21.253303 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-f88d9e1f-75f9-434b-b093-e10720a6f41b tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1260 microversion: 2.1 time: 0.150269 Jun 03 10:01:21.253880 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 266/567] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:21 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:21.701614 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-95b0eac8-1793-4cfd-9437-9016180d2b87 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:21.702452 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-95b0eac8-1793-4cfd-9437-9016180d2b87 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:21.708864 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-95b0eac8-1793-4cfd-9437-9016180d2b87 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:21.709314 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-95b0eac8-1793-4cfd-9437-9016180d2b87 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:21.710106 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-95b0eac8-1793-4cfd-9437-9016180d2b87 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:21.710546 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-95b0eac8-1793-4cfd-9437-9016180d2b87 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:21.837579 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-95b0eac8-1793-4cfd-9437-9016180d2b87 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:21.845928 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-95b0eac8-1793-4cfd-9437-9016180d2b87 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:21.847327 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-95b0eac8-1793-4cfd-9437-9016180d2b87 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:21.848464 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-95b0eac8-1793-4cfd-9437-9016180d2b87 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1808 microversion: 2.20 time: 0.150819 Jun 03 10:01:21.849020 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 302/568] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:21 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:21.996977 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-7574f18c-bbcb-4eff-ab21-1d8950ce32a2 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:21.998018 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-7574f18c-bbcb-4eff-ab21-1d8950ce32a2 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:22.004080 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7574f18c-bbcb-4eff-ab21-1d8950ce32a2 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:22.004529 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7574f18c-bbcb-4eff-ab21-1d8950ce32a2 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:22.005294 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7574f18c-bbcb-4eff-ab21-1d8950ce32a2 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:22.005732 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7574f18c-bbcb-4eff-ab21-1d8950ce32a2 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:22.146059 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-7574f18c-bbcb-4eff-ab21-1d8950ce32a2 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:22.153981 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-7574f18c-bbcb-4eff-ab21-1d8950ce32a2 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1753 microversion: 2.1 time: 0.160766 Jun 03 10:01:22.154542 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 267/569] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:21 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:22.268966 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-0615745b-b77f-4279-b8e0-a48be9f5c918 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:22.269582 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-0615745b-b77f-4279-b8e0-a48be9f5c918 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:22.275632 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0615745b-b77f-4279-b8e0-a48be9f5c918 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:22.276087 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0615745b-b77f-4279-b8e0-a48be9f5c918 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:22.276849 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0615745b-b77f-4279-b8e0-a48be9f5c918 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:22.277289 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0615745b-b77f-4279-b8e0-a48be9f5c918 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:22.408194 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-0615745b-b77f-4279-b8e0-a48be9f5c918 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:22.415835 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-0615745b-b77f-4279-b8e0-a48be9f5c918 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1260 microversion: 2.1 time: 0.150660 Jun 03 10:01:22.416402 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 303/570] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:22 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:22.866556 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-21e278a0-63b7-4471-9357-afd2c66f1ada tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:22.867159 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-21e278a0-63b7-4471-9357-afd2c66f1ada tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:22.873156 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-21e278a0-63b7-4471-9357-afd2c66f1ada tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:22.873580 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-21e278a0-63b7-4471-9357-afd2c66f1ada tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:22.874371 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-21e278a0-63b7-4471-9357-afd2c66f1ada tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:22.874808 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-21e278a0-63b7-4471-9357-afd2c66f1ada tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:23.003253 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-21e278a0-63b7-4471-9357-afd2c66f1ada tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:23.011719 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-21e278a0-63b7-4471-9357-afd2c66f1ada tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:23.013239 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-21e278a0-63b7-4471-9357-afd2c66f1ada tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:23.014438 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-21e278a0-63b7-4471-9357-afd2c66f1ada tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1808 microversion: 2.20 time: 0.151816 Jun 03 10:01:23.014984 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 268/571] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:22 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:23.171702 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-7e4c10f6-186f-4e84-accc-b41dafbd1255 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:23.172309 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-7e4c10f6-186f-4e84-accc-b41dafbd1255 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:23.178779 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7e4c10f6-186f-4e84-accc-b41dafbd1255 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:23.179229 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7e4c10f6-186f-4e84-accc-b41dafbd1255 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:23.179989 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7e4c10f6-186f-4e84-accc-b41dafbd1255 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:23.180451 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7e4c10f6-186f-4e84-accc-b41dafbd1255 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:23.318073 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-7e4c10f6-186f-4e84-accc-b41dafbd1255 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:23.325968 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-7e4c10f6-186f-4e84-accc-b41dafbd1255 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1753 microversion: 2.1 time: 0.158150 Jun 03 10:01:23.326536 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 304/572] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:23 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:23.432681 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-f6a168f2-8c4e-46df-8352-e4bd83f17039 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:23.433294 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-f6a168f2-8c4e-46df-8352-e4bd83f17039 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:23.440368 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f6a168f2-8c4e-46df-8352-e4bd83f17039 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:23.440817 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f6a168f2-8c4e-46df-8352-e4bd83f17039 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:23.441576 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f6a168f2-8c4e-46df-8352-e4bd83f17039 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:23.442065 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f6a168f2-8c4e-46df-8352-e4bd83f17039 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:23.573542 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f6a168f2-8c4e-46df-8352-e4bd83f17039 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:23.581686 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-f6a168f2-8c4e-46df-8352-e4bd83f17039 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1260 microversion: 2.1 time: 0.153172 Jun 03 10:01:23.582326 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 269/573] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:23 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:24.032971 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-de91126c-5c64-42cf-96cf-c352ad9ce339 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:24.033860 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-de91126c-5c64-42cf-96cf-c352ad9ce339 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:24.039883 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-de91126c-5c64-42cf-96cf-c352ad9ce339 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:24.040335 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-de91126c-5c64-42cf-96cf-c352ad9ce339 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:24.041101 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-de91126c-5c64-42cf-96cf-c352ad9ce339 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:24.041542 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-de91126c-5c64-42cf-96cf-c352ad9ce339 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:24.179841 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-de91126c-5c64-42cf-96cf-c352ad9ce339 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:24.189675 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-de91126c-5c64-42cf-96cf-c352ad9ce339 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:24.191368 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-de91126c-5c64-42cf-96cf-c352ad9ce339 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:24.192666 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-de91126c-5c64-42cf-96cf-c352ad9ce339 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1808 microversion: 2.20 time: 0.164119 Jun 03 10:01:24.193323 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 305/574] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:24 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:24.343405 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-6c0ed258-ab15-4d5e-8555-a1985f8a4397 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:24.343942 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-6c0ed258-ab15-4d5e-8555-a1985f8a4397 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:24.350018 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6c0ed258-ab15-4d5e-8555-a1985f8a4397 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:24.350462 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6c0ed258-ab15-4d5e-8555-a1985f8a4397 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:24.351211 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6c0ed258-ab15-4d5e-8555-a1985f8a4397 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:24.351637 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6c0ed258-ab15-4d5e-8555-a1985f8a4397 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:24.488037 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-6c0ed258-ab15-4d5e-8555-a1985f8a4397 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:24.495998 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-6c0ed258-ab15-4d5e-8555-a1985f8a4397 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1753 microversion: 2.1 time: 0.156403 Jun 03 10:01:24.496562 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 270/575] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:24 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1753 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:24.598711 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-1f1e469d-c258-43dc-ae49-dde89e83b005 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:24.599249 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-1f1e469d-c258-43dc-ae49-dde89e83b005 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:24.605191 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1f1e469d-c258-43dc-ae49-dde89e83b005 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:24.605644 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1f1e469d-c258-43dc-ae49-dde89e83b005 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:24.606426 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1f1e469d-c258-43dc-ae49-dde89e83b005 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:24.606855 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1f1e469d-c258-43dc-ae49-dde89e83b005 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:24.739078 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-1f1e469d-c258-43dc-ae49-dde89e83b005 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:24.746739 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-1f1e469d-c258-43dc-ae49-dde89e83b005 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1260 microversion: 2.1 time: 0.151856 Jun 03 10:01:24.747302 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 306/576] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:24 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:25.211503 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-c4bef04e-50d9-4702-9d87-ff0d6650c14e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:25.212119 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-c4bef04e-50d9-4702-9d87-ff0d6650c14e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:25.218207 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c4bef04e-50d9-4702-9d87-ff0d6650c14e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:25.219162 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c4bef04e-50d9-4702-9d87-ff0d6650c14e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:25.219954 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c4bef04e-50d9-4702-9d87-ff0d6650c14e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:25.220393 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c4bef04e-50d9-4702-9d87-ff0d6650c14e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:25.349174 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-c4bef04e-50d9-4702-9d87-ff0d6650c14e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:25.357577 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-c4bef04e-50d9-4702-9d87-ff0d6650c14e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:25.359157 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-c4bef04e-50d9-4702-9d87-ff0d6650c14e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:25.360318 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-c4bef04e-50d9-4702-9d87-ff0d6650c14e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1808 microversion: 2.20 time: 0.152705 Jun 03 10:01:25.360876 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 271/577] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:25 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:25.513702 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-5e414da2-d44f-44dc-9679-1884ce471199 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:25.514331 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-5e414da2-d44f-44dc-9679-1884ce471199 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:25.522265 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5e414da2-d44f-44dc-9679-1884ce471199 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:25.522724 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5e414da2-d44f-44dc-9679-1884ce471199 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:25.523501 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5e414da2-d44f-44dc-9679-1884ce471199 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:25.523937 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5e414da2-d44f-44dc-9679-1884ce471199 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:25.666078 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-5e414da2-d44f-44dc-9679-1884ce471199 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:25.674064 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-5e414da2-d44f-44dc-9679-1884ce471199 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1753 microversion: 2.1 time: 0.164151 Jun 03 10:01:25.674627 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 307/578] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:25 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1753 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:25.763706 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-771e0b96-a3b4-4cb7-b37b-d52790cdb14b tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:25.764230 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-771e0b96-a3b4-4cb7-b37b-d52790cdb14b tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:25.771371 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-771e0b96-a3b4-4cb7-b37b-d52790cdb14b tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:25.771821 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-771e0b96-a3b4-4cb7-b37b-d52790cdb14b tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:25.772568 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-771e0b96-a3b4-4cb7-b37b-d52790cdb14b tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:25.772999 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-771e0b96-a3b4-4cb7-b37b-d52790cdb14b tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:25.902423 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-771e0b96-a3b4-4cb7-b37b-d52790cdb14b tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:25.910175 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-771e0b96-a3b4-4cb7-b37b-d52790cdb14b tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1260 microversion: 2.1 time: 0.150302 Jun 03 10:01:25.910732 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 272/579] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:25 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:26.378983 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-166ed07e-452b-4f92-9a48-3e45600cd520 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:26.379602 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-166ed07e-452b-4f92-9a48-3e45600cd520 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:26.385686 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-166ed07e-452b-4f92-9a48-3e45600cd520 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:26.386184 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-166ed07e-452b-4f92-9a48-3e45600cd520 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:26.386947 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-166ed07e-452b-4f92-9a48-3e45600cd520 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:26.387382 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-166ed07e-452b-4f92-9a48-3e45600cd520 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:26.514279 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-166ed07e-452b-4f92-9a48-3e45600cd520 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:26.522733 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-166ed07e-452b-4f92-9a48-3e45600cd520 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:26.524214 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-166ed07e-452b-4f92-9a48-3e45600cd520 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:26.525358 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-166ed07e-452b-4f92-9a48-3e45600cd520 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1808 microversion: 2.20 time: 0.150801 Jun 03 10:01:26.525930 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 308/580] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:26 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:26.691010 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-981f8d85-af60-41b6-b5a9-4b4ca3b9fa75 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:26.691618 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-981f8d85-af60-41b6-b5a9-4b4ca3b9fa75 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:26.693443 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell0:SELECT=2 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:01:26.694197 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell0:SELECT=6 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:01:26.700071 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-981f8d85-af60-41b6-b5a9-4b4ca3b9fa75 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:26.700512 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-981f8d85-af60-41b6-b5a9-4b4ca3b9fa75 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:26.701264 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-981f8d85-af60-41b6-b5a9-4b4ca3b9fa75 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:26.701693 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-981f8d85-af60-41b6-b5a9-4b4ca3b9fa75 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:26.845650 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-981f8d85-af60-41b6-b5a9-4b4ca3b9fa75 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:26.853627 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-981f8d85-af60-41b6-b5a9-4b4ca3b9fa75 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1753 microversion: 2.1 time: 0.166385 Jun 03 10:01:26.854236 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 273/581] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:26 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:26.929315 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-67d1d048-7e64-4b63-826a-4bbd2d132e0c tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:26.929897 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-67d1d048-7e64-4b63-826a-4bbd2d132e0c tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:26.931752 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell0:SELECT=2 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:01:26.937538 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-67d1d048-7e64-4b63-826a-4bbd2d132e0c tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:26.938026 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-67d1d048-7e64-4b63-826a-4bbd2d132e0c tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:26.938796 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-67d1d048-7e64-4b63-826a-4bbd2d132e0c tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:26.939240 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-67d1d048-7e64-4b63-826a-4bbd2d132e0c tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:27.068407 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-67d1d048-7e64-4b63-826a-4bbd2d132e0c tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:27.075852 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-67d1d048-7e64-4b63-826a-4bbd2d132e0c tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1260 microversion: 2.1 time: 0.150494 Jun 03 10:01:27.076410 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 309/582] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:26 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:27.544315 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-7f47bbf9-dfdb-4f35-9043-58ca393d0cce tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:27.544932 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-7f47bbf9-dfdb-4f35-9043-58ca393d0cce tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:27.551639 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7f47bbf9-dfdb-4f35-9043-58ca393d0cce tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:27.552087 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7f47bbf9-dfdb-4f35-9043-58ca393d0cce tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:27.552852 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7f47bbf9-dfdb-4f35-9043-58ca393d0cce tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:27.553291 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7f47bbf9-dfdb-4f35-9043-58ca393d0cce tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:27.681138 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-7f47bbf9-dfdb-4f35-9043-58ca393d0cce tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:27.689463 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-7f47bbf9-dfdb-4f35-9043-58ca393d0cce tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:27.691011 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-7f47bbf9-dfdb-4f35-9043-58ca393d0cce tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:27.692162 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-7f47bbf9-dfdb-4f35-9043-58ca393d0cce tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1808 microversion: 2.20 time: 0.151726 Jun 03 10:01:27.692706 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 274/583] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:27 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:27.871039 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-7503eeb6-c3e9-45a7-afa9-ef55d5dd0261 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:27.871638 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-7503eeb6-c3e9-45a7-afa9-ef55d5dd0261 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:27.878139 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7503eeb6-c3e9-45a7-afa9-ef55d5dd0261 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:27.878585 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7503eeb6-c3e9-45a7-afa9-ef55d5dd0261 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:27.879337 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7503eeb6-c3e9-45a7-afa9-ef55d5dd0261 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:27.879762 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7503eeb6-c3e9-45a7-afa9-ef55d5dd0261 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:28.019923 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-7503eeb6-c3e9-45a7-afa9-ef55d5dd0261 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:28.027833 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-7503eeb6-c3e9-45a7-afa9-ef55d5dd0261 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1753 microversion: 2.1 time: 0.160676 Jun 03 10:01:28.028391 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 310/584] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:27 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:28.092523 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-1ed81641-a58a-43ab-ac6b-d01385146d7d tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:28.093139 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-1ed81641-a58a-43ab-ac6b-d01385146d7d tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:28.099742 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1ed81641-a58a-43ab-ac6b-d01385146d7d tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:28.100179 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1ed81641-a58a-43ab-ac6b-d01385146d7d tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:28.100945 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1ed81641-a58a-43ab-ac6b-d01385146d7d tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:28.101385 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1ed81641-a58a-43ab-ac6b-d01385146d7d tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:28.231399 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-1ed81641-a58a-43ab-ac6b-d01385146d7d tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:28.238787 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-1ed81641-a58a-43ab-ac6b-d01385146d7d tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1260 microversion: 2.1 time: 0.150053 Jun 03 10:01:28.239380 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 275/585] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:28 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:28.709956 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-0ba01a6a-3e57-410c-ba2c-f88e6df70485 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:28.710572 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-0ba01a6a-3e57-410c-ba2c-f88e6df70485 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:28.716698 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0ba01a6a-3e57-410c-ba2c-f88e6df70485 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:28.717150 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0ba01a6a-3e57-410c-ba2c-f88e6df70485 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:28.717946 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0ba01a6a-3e57-410c-ba2c-f88e6df70485 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:28.718882 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0ba01a6a-3e57-410c-ba2c-f88e6df70485 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:28.845741 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-0ba01a6a-3e57-410c-ba2c-f88e6df70485 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:28.854186 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-0ba01a6a-3e57-410c-ba2c-f88e6df70485 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:28.855688 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-0ba01a6a-3e57-410c-ba2c-f88e6df70485 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:28.856842 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-0ba01a6a-3e57-410c-ba2c-f88e6df70485 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1808 microversion: 2.20 time: 0.150790 Jun 03 10:01:28.857397 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 311/586] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:28 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 10:01:29.045456 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-9dddee83-f3a9-4181-aec0-6763ad602c7a tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:29.046102 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-9dddee83-f3a9-4181-aec0-6763ad602c7a tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:29.052616 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9dddee83-f3a9-4181-aec0-6763ad602c7a tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:29.053064 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9dddee83-f3a9-4181-aec0-6763ad602c7a tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:29.053856 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9dddee83-f3a9-4181-aec0-6763ad602c7a tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:29.054293 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9dddee83-f3a9-4181-aec0-6763ad602c7a tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:29.191830 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-9dddee83-f3a9-4181-aec0-6763ad602c7a tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:29.199688 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-9dddee83-f3a9-4181-aec0-6763ad602c7a tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1753 microversion: 2.1 time: 0.158062 Jun 03 10:01:29.200249 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 276/587] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:29 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1753 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:29.255930 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-04823ead-39b0-424b-b9c8-1be23fe3ebeb tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:29.256484 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-04823ead-39b0-424b-b9c8-1be23fe3ebeb tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:29.262969 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-04823ead-39b0-424b-b9c8-1be23fe3ebeb tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:29.263423 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-04823ead-39b0-424b-b9c8-1be23fe3ebeb tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:29.264188 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-04823ead-39b0-424b-b9c8-1be23fe3ebeb tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:29.264626 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-04823ead-39b0-424b-b9c8-1be23fe3ebeb tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:29.393574 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-04823ead-39b0-424b-b9c8-1be23fe3ebeb tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:29.401063 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-04823ead-39b0-424b-b9c8-1be23fe3ebeb tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1260 microversion: 2.1 time: 0.149003 Jun 03 10:01:29.401626 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 312/588] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:29 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:01:29.874964 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-bb3ec757-3ebd-4019-8861-87e4a72b6124 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:29.875598 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-bb3ec757-3ebd-4019-8861-87e4a72b6124 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:29.881942 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-bb3ec757-3ebd-4019-8861-87e4a72b6124 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:29.882381 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-bb3ec757-3ebd-4019-8861-87e4a72b6124 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:29.883130 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-bb3ec757-3ebd-4019-8861-87e4a72b6124 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:29.883559 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-bb3ec757-3ebd-4019-8861-87e4a72b6124 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:30.008952 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-bb3ec757-3ebd-4019-8861-87e4a72b6124 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:30.017655 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-bb3ec757-3ebd-4019-8861-87e4a72b6124 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:30.019168 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-bb3ec757-3ebd-4019-8861-87e4a72b6124 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:30.020321 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-bb3ec757-3ebd-4019-8861-87e4a72b6124 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1808 microversion: 2.20 time: 0.149214 Jun 03 10:01:30.020866 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 277/589] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:29 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1808 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:30.216584 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-e53ceee8-d599-495e-8642-692dd7a2ae97 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:30.217194 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-e53ceee8-d599-495e-8642-692dd7a2ae97 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:30.223354 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e53ceee8-d599-495e-8642-692dd7a2ae97 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:30.223802 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e53ceee8-d599-495e-8642-692dd7a2ae97 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:30.224558 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e53ceee8-d599-495e-8642-692dd7a2ae97 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:30.224994 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e53ceee8-d599-495e-8642-692dd7a2ae97 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:30.366631 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-e53ceee8-d599-495e-8642-692dd7a2ae97 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:30.375242 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-e53ceee8-d599-495e-8642-692dd7a2ae97 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1753 microversion: 2.1 time: 0.161901 Jun 03 10:01:30.375813 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 313/590] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:30 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:30.417580 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-9bd3afd4-abc4-4add-b6c5-e9a535b6914a tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:30.418253 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-9bd3afd4-abc4-4add-b6c5-e9a535b6914a tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:30.424694 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9bd3afd4-abc4-4add-b6c5-e9a535b6914a tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:30.425140 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9bd3afd4-abc4-4add-b6c5-e9a535b6914a tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:30.425931 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9bd3afd4-abc4-4add-b6c5-e9a535b6914a tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:30.426370 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9bd3afd4-abc4-4add-b6c5-e9a535b6914a tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:30.555297 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-9bd3afd4-abc4-4add-b6c5-e9a535b6914a tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:30.563665 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-9bd3afd4-abc4-4add-b6c5-e9a535b6914a tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1260 microversion: 2.1 time: 0.149933 Jun 03 10:01:30.564227 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 278/591] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:30 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:31.038765 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-680991d2-416d-4d99-9d3a-d54af8d552c7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:31.039383 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-680991d2-416d-4d99-9d3a-d54af8d552c7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:31.046254 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-680991d2-416d-4d99-9d3a-d54af8d552c7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:31.046706 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-680991d2-416d-4d99-9d3a-d54af8d552c7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:31.047489 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-680991d2-416d-4d99-9d3a-d54af8d552c7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:31.047931 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-680991d2-416d-4d99-9d3a-d54af8d552c7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:31.180954 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-680991d2-416d-4d99-9d3a-d54af8d552c7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:31.189890 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-680991d2-416d-4d99-9d3a-d54af8d552c7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:31.191400 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-680991d2-416d-4d99-9d3a-d54af8d552c7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:31.192566 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-680991d2-416d-4d99-9d3a-d54af8d552c7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1808 microversion: 2.20 time: 0.157688 Jun 03 10:01:31.193125 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 314/592] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:31 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:31.393023 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-ecee3b33-10f0-40c5-bc04-d217435e67b1 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:31.393404 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-ecee3b33-10f0-40c5-bc04-d217435e67b1 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:31.399711 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ecee3b33-10f0-40c5-bc04-d217435e67b1 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:31.400173 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ecee3b33-10f0-40c5-bc04-d217435e67b1 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:31.400951 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ecee3b33-10f0-40c5-bc04-d217435e67b1 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:31.401396 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ecee3b33-10f0-40c5-bc04-d217435e67b1 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:31.547877 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-ecee3b33-10f0-40c5-bc04-d217435e67b1 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:31.556688 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-ecee3b33-10f0-40c5-bc04-d217435e67b1 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1753 microversion: 2.1 time: 0.168163 Jun 03 10:01:31.557692 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 279/593] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:31 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:31.580868 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-503a8d12-e757-4b83-aa0d-be2eee575e57 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:31.584081 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-503a8d12-e757-4b83-aa0d-be2eee575e57 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:31.591100 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-503a8d12-e757-4b83-aa0d-be2eee575e57 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:31.591739 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-503a8d12-e757-4b83-aa0d-be2eee575e57 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:31.592602 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-503a8d12-e757-4b83-aa0d-be2eee575e57 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:31.593267 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-503a8d12-e757-4b83-aa0d-be2eee575e57 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:31.705666 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-ade55241-b337-4f19-b5c7-c2ade6b2bdee tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:01:31.707140 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-ade55241-b337-4f19-b5c7-c2ade6b2bdee tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:31.713403 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ade55241-b337-4f19-b5c7-c2ade6b2bdee tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:31.713962 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ade55241-b337-4f19-b5c7-c2ade6b2bdee tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:31.714961 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ade55241-b337-4f19-b5c7-c2ade6b2bdee tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:31.715487 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ade55241-b337-4f19-b5c7-c2ade6b2bdee tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:31.738234 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.objects.instance [None req-ade55241-b337-4f19-b5c7-c2ade6b2bdee tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lazy-loading 'flavor' on Instance uuid fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 {{(pid=117648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:01:31.744795 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-503a8d12-e757-4b83-aa0d-be2eee575e57 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:31.754261 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-503a8d12-e757-4b83-aa0d-be2eee575e57 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1260 microversion: 2.1 time: 0.177345 Jun 03 10:01:31.755065 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 315/594] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:31 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1260 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:31.840713 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:01:31.860596 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-ade55241-b337-4f19-b5c7-c2ade6b2bdee tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "POST /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6/action" status: 200 len: 32 microversion: 2.1 time: 0.159694 Jun 03 10:01:31.861184 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 280/595] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jun 3 10:01:31 2022] POST /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6/action => generated 32 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 03 10:01:31.870286 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-8b5a0f76-972d-45e5-a912-316e10a4a5df tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:31.870892 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-8b5a0f76-972d-45e5-a912-316e10a4a5df tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:31.877871 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8b5a0f76-972d-45e5-a912-316e10a4a5df tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:31.878407 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8b5a0f76-972d-45e5-a912-316e10a4a5df tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:31.879215 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8b5a0f76-972d-45e5-a912-316e10a4a5df tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:31.879660 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8b5a0f76-972d-45e5-a912-316e10a4a5df tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:32.012910 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-8b5a0f76-972d-45e5-a912-316e10a4a5df tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:32.016085 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=100 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:01:32.023365 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-8b5a0f76-972d-45e5-a912-316e10a4a5df tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6" status: 200 len: 1734 microversion: 2.1 time: 0.156878 Jun 03 10:01:32.023944 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 316/596] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:31 2022] GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:32.212043 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-1fbcef90-f89e-4747-a8f6-79182b7d4d76 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:32.212670 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-1fbcef90-f89e-4747-a8f6-79182b7d4d76 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:32.219582 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1fbcef90-f89e-4747-a8f6-79182b7d4d76 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:32.220032 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1fbcef90-f89e-4747-a8f6-79182b7d4d76 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:32.220797 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1fbcef90-f89e-4747-a8f6-79182b7d4d76 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:32.221235 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1fbcef90-f89e-4747-a8f6-79182b7d4d76 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:32.355398 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-1fbcef90-f89e-4747-a8f6-79182b7d4d76 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:32.363929 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-1fbcef90-f89e-4747-a8f6-79182b7d4d76 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:32.365441 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-1fbcef90-f89e-4747-a8f6-79182b7d4d76 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:32.366633 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-1fbcef90-f89e-4747-a8f6-79182b7d4d76 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1808 microversion: 2.20 time: 0.159019 Jun 03 10:01:32.367413 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 281/597] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:32 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:32.574065 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-8d197650-b6e0-4d7d-906b-a35bde13ca0c tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:32.574690 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-8d197650-b6e0-4d7d-906b-a35bde13ca0c tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:32.581193 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8d197650-b6e0-4d7d-906b-a35bde13ca0c tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:32.581789 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8d197650-b6e0-4d7d-906b-a35bde13ca0c tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:32.582422 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8d197650-b6e0-4d7d-906b-a35bde13ca0c tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:32.582860 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8d197650-b6e0-4d7d-906b-a35bde13ca0c tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:32.736275 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-8d197650-b6e0-4d7d-906b-a35bde13ca0c tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:32.744420 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-8d197650-b6e0-4d7d-906b-a35bde13ca0c tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1753 microversion: 2.1 time: 0.174413 Jun 03 10:01:32.745032 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 317/598] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:32 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1753 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:32.771458 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-135cc2fb-9b45-4411-90e6-541417568876 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:32.772083 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-135cc2fb-9b45-4411-90e6-541417568876 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:32.778873 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-135cc2fb-9b45-4411-90e6-541417568876 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:32.779328 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-135cc2fb-9b45-4411-90e6-541417568876 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:32.780096 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-135cc2fb-9b45-4411-90e6-541417568876 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:32.780535 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-135cc2fb-9b45-4411-90e6-541417568876 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:32.910564 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-135cc2fb-9b45-4411-90e6-541417568876 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:32.918293 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-135cc2fb-9b45-4411-90e6-541417568876 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1260 microversion: 2.1 time: 0.150646 Jun 03 10:01:32.918947 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 282/599] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:32 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:33.040550 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-d0f68372-fc7a-48d7-a3a3-7034dd902ce9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:33.041285 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-d0f68372-fc7a-48d7-a3a3-7034dd902ce9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:33.048038 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d0f68372-fc7a-48d7-a3a3-7034dd902ce9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:33.048486 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d0f68372-fc7a-48d7-a3a3-7034dd902ce9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:33.049254 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d0f68372-fc7a-48d7-a3a3-7034dd902ce9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:33.049690 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d0f68372-fc7a-48d7-a3a3-7034dd902ce9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:33.173268 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-d0f68372-fc7a-48d7-a3a3-7034dd902ce9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:33.181098 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-d0f68372-fc7a-48d7-a3a3-7034dd902ce9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6" status: 200 len: 1734 microversion: 2.1 time: 0.144414 Jun 03 10:01:33.181669 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 318/600] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:33 2022] GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 => generated 1734 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:33.384525 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-82d7dd37-2280-4af1-a8c3-57f59974b144 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:33.385100 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-82d7dd37-2280-4af1-a8c3-57f59974b144 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:33.391435 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-82d7dd37-2280-4af1-a8c3-57f59974b144 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:33.391892 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-82d7dd37-2280-4af1-a8c3-57f59974b144 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:33.392683 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-82d7dd37-2280-4af1-a8c3-57f59974b144 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:33.393157 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-82d7dd37-2280-4af1-a8c3-57f59974b144 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:33.522092 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-82d7dd37-2280-4af1-a8c3-57f59974b144 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:33.530482 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-82d7dd37-2280-4af1-a8c3-57f59974b144 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:33.532490 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-82d7dd37-2280-4af1-a8c3-57f59974b144 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:33.533629 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-82d7dd37-2280-4af1-a8c3-57f59974b144 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1808 microversion: 2.20 time: 0.153088 Jun 03 10:01:33.534468 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 283/601] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:33 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:33.763577 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-036a540f-3298-405a-a783-b485ba0952ea tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:33.764190 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-036a540f-3298-405a-a783-b485ba0952ea tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:33.771190 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-036a540f-3298-405a-a783-b485ba0952ea tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:33.771637 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-036a540f-3298-405a-a783-b485ba0952ea tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:33.772400 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-036a540f-3298-405a-a783-b485ba0952ea tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:33.772837 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-036a540f-3298-405a-a783-b485ba0952ea tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:33.910491 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-036a540f-3298-405a-a783-b485ba0952ea tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:33.918525 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-036a540f-3298-405a-a783-b485ba0952ea tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1753 microversion: 2.1 time: 0.159277 Jun 03 10:01:33.919110 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 319/602] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:33 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:33.935406 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-c1adcf2f-d1fc-40d6-ae03-a1df85800470 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:33.936022 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-c1adcf2f-d1fc-40d6-ae03-a1df85800470 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:33.943201 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c1adcf2f-d1fc-40d6-ae03-a1df85800470 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:33.943678 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c1adcf2f-d1fc-40d6-ae03-a1df85800470 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:33.944437 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c1adcf2f-d1fc-40d6-ae03-a1df85800470 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:33.944871 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c1adcf2f-d1fc-40d6-ae03-a1df85800470 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:34.080818 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-c1adcf2f-d1fc-40d6-ae03-a1df85800470 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:34.088181 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-c1adcf2f-d1fc-40d6-ae03-a1df85800470 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1260 microversion: 2.1 time: 0.156894 Jun 03 10:01:34.088741 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 284/603] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:33 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:34.198816 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-dfc5daeb-b277-4a66-85d1-9a09ed947f1d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:34.199447 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-dfc5daeb-b277-4a66-85d1-9a09ed947f1d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:34.206067 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-dfc5daeb-b277-4a66-85d1-9a09ed947f1d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:34.206506 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-dfc5daeb-b277-4a66-85d1-9a09ed947f1d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:34.207255 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-dfc5daeb-b277-4a66-85d1-9a09ed947f1d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:34.207685 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-dfc5daeb-b277-4a66-85d1-9a09ed947f1d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:34.334695 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-dfc5daeb-b277-4a66-85d1-9a09ed947f1d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:34.342862 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-dfc5daeb-b277-4a66-85d1-9a09ed947f1d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6" status: 200 len: 1734 microversion: 2.1 time: 0.147835 Jun 03 10:01:34.343421 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 320/604] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:34 2022] GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:34.552603 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-d758495f-9fdf-47e7-8b18-1c76252d383d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:34.553142 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-d758495f-9fdf-47e7-8b18-1c76252d383d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:34.559261 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d758495f-9fdf-47e7-8b18-1c76252d383d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:34.559711 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d758495f-9fdf-47e7-8b18-1c76252d383d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:34.560476 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d758495f-9fdf-47e7-8b18-1c76252d383d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:34.560918 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d758495f-9fdf-47e7-8b18-1c76252d383d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:34.703600 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d758495f-9fdf-47e7-8b18-1c76252d383d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:34.712580 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d758495f-9fdf-47e7-8b18-1c76252d383d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:34.714261 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d758495f-9fdf-47e7-8b18-1c76252d383d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:34.716814 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-d758495f-9fdf-47e7-8b18-1c76252d383d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1808 microversion: 2.20 time: 0.166948 Jun 03 10:01:34.716814 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 285/605] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:34 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:34.936019 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-16935b4b-63d4-46ec-8bd4-d0c83bd808de tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:34.936561 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-16935b4b-63d4-46ec-8bd4-d0c83bd808de tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:34.943054 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-16935b4b-63d4-46ec-8bd4-d0c83bd808de tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:34.943511 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-16935b4b-63d4-46ec-8bd4-d0c83bd808de tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:34.944278 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-16935b4b-63d4-46ec-8bd4-d0c83bd808de tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:34.944749 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-16935b4b-63d4-46ec-8bd4-d0c83bd808de tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:35.082750 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-16935b4b-63d4-46ec-8bd4-d0c83bd808de tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:35.090557 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-16935b4b-63d4-46ec-8bd4-d0c83bd808de tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1753 microversion: 2.1 time: 0.158591 Jun 03 10:01:35.091124 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 321/606] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:34 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1753 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:35.104101 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-58c404ac-9f19-42e1-afc7-7991647403e9 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:35.104716 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-58c404ac-9f19-42e1-afc7-7991647403e9 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:35.111174 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-58c404ac-9f19-42e1-afc7-7991647403e9 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:35.111628 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-58c404ac-9f19-42e1-afc7-7991647403e9 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:35.112389 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-58c404ac-9f19-42e1-afc7-7991647403e9 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:35.112828 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-58c404ac-9f19-42e1-afc7-7991647403e9 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:35.239554 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-58c404ac-9f19-42e1-afc7-7991647403e9 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:35.246991 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-58c404ac-9f19-42e1-afc7-7991647403e9 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1260 microversion: 2.1 time: 0.146642 Jun 03 10:01:35.247557 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 286/607] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:35 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1260 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:35.359693 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-c67c2fe2-2ed1-4fc6-ad69-477ff8716b36 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:35.360309 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-c67c2fe2-2ed1-4fc6-ad69-477ff8716b36 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:35.366418 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c67c2fe2-2ed1-4fc6-ad69-477ff8716b36 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:35.366872 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c67c2fe2-2ed1-4fc6-ad69-477ff8716b36 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:35.367641 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c67c2fe2-2ed1-4fc6-ad69-477ff8716b36 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:35.368080 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c67c2fe2-2ed1-4fc6-ad69-477ff8716b36 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:35.496829 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-c67c2fe2-2ed1-4fc6-ad69-477ff8716b36 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:35.506153 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-c67c2fe2-2ed1-4fc6-ad69-477ff8716b36 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6" status: 200 len: 1734 microversion: 2.1 time: 0.150207 Jun 03 10:01:35.506724 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 322/608] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:35 2022] GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:35.669901 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-d5532df7-adb9-4732-b805-fd46b374fcf0 req-35af522d-94eb-4177-a305-5ca555e87c0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f", "name": "network-vif-plugged", "status": "completed", "tag": "d6b08e27-3091-4087-a29a-03ef6cbbdc0a"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:01:35.678585 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-d5532df7-adb9-4732-b805-fd46b374fcf0 req-35af522d-94eb-4177-a305-5ca555e87c0e service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:35.679063 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-d5532df7-adb9-4732-b805-fd46b374fcf0 req-35af522d-94eb-4177-a305-5ca555e87c0e service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:35.690473 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-d5532df7-adb9-4732-b805-fd46b374fcf0 req-35af522d-94eb-4177-a305-5ca555e87c0e service nova] Creating event network-vif-plugged:d6b08e27-3091-4087-a29a-03ef6cbbdc0a for instance 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f on hv-cinder-79760 Jun 03 10:01:35.695318 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-d5532df7-adb9-4732-b805-fd46b374fcf0 req-35af522d-94eb-4177-a305-5ca555e87c0e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029552 Jun 03 10:01:35.695897 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 287/609] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:01:35.734645 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-b7ba866a-2ceb-4379-aab8-048288683c3d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:35.735258 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-b7ba866a-2ceb-4379-aab8-048288683c3d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:35.741303 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b7ba866a-2ceb-4379-aab8-048288683c3d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:35.741761 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b7ba866a-2ceb-4379-aab8-048288683c3d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:35.742534 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b7ba866a-2ceb-4379-aab8-048288683c3d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:35.742996 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b7ba866a-2ceb-4379-aab8-048288683c3d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:35.893208 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-b7ba866a-2ceb-4379-aab8-048288683c3d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:35.902840 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-b7ba866a-2ceb-4379-aab8-048288683c3d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:35.904471 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-b7ba866a-2ceb-4379-aab8-048288683c3d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:35.905652 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-b7ba866a-2ceb-4379-aab8-048288683c3d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1808 microversion: 2.20 time: 0.175013 Jun 03 10:01:35.906341 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 323/610] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:35 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:36.109577 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-3e6967b2-2214-4b39-90e3-46a8eacee2bc tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:36.110240 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-3e6967b2-2214-4b39-90e3-46a8eacee2bc tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:36.116953 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3e6967b2-2214-4b39-90e3-46a8eacee2bc tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:36.117404 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3e6967b2-2214-4b39-90e3-46a8eacee2bc tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:36.118192 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3e6967b2-2214-4b39-90e3-46a8eacee2bc tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:36.118639 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3e6967b2-2214-4b39-90e3-46a8eacee2bc tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:36.259652 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-3e6967b2-2214-4b39-90e3-46a8eacee2bc tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:36.264156 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-8b75dd50-be6c-44d1-967d-3007831f086f tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:36.264793 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-8b75dd50-be6c-44d1-967d-3007831f086f tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:36.268359 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-3e6967b2-2214-4b39-90e3-46a8eacee2bc tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1753 microversion: 2.1 time: 0.163671 Jun 03 10:01:36.268928 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 288/611] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:36 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:36.271962 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8b75dd50-be6c-44d1-967d-3007831f086f tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:36.272424 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8b75dd50-be6c-44d1-967d-3007831f086f tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:36.273195 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8b75dd50-be6c-44d1-967d-3007831f086f tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:36.273636 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8b75dd50-be6c-44d1-967d-3007831f086f tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:36.404110 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-8b75dd50-be6c-44d1-967d-3007831f086f tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:36.411723 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-8b75dd50-be6c-44d1-967d-3007831f086f tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1260 microversion: 2.1 time: 0.151462 Jun 03 10:01:36.412276 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 324/612] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:36 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:01:36.524038 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-3d90e0e3-b736-426f-93f5-ed3bc19cbd80 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:36.524655 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-3d90e0e3-b736-426f-93f5-ed3bc19cbd80 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:36.530804 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3d90e0e3-b736-426f-93f5-ed3bc19cbd80 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:36.531253 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3d90e0e3-b736-426f-93f5-ed3bc19cbd80 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:36.532022 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3d90e0e3-b736-426f-93f5-ed3bc19cbd80 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:36.532461 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3d90e0e3-b736-426f-93f5-ed3bc19cbd80 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:36.659660 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-3d90e0e3-b736-426f-93f5-ed3bc19cbd80 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:36.667865 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-3d90e0e3-b736-426f-93f5-ed3bc19cbd80 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6" status: 200 len: 1734 microversion: 2.1 time: 0.147662 Jun 03 10:01:36.668424 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 289/613] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:36 2022] GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:36.925039 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-73b6aad3-ce30-4b51-a3fd-0207d79e40ef tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:36.925614 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-73b6aad3-ce30-4b51-a3fd-0207d79e40ef tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:36.931663 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-73b6aad3-ce30-4b51-a3fd-0207d79e40ef tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:36.932111 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-73b6aad3-ce30-4b51-a3fd-0207d79e40ef tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:36.932889 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-73b6aad3-ce30-4b51-a3fd-0207d79e40ef tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:36.933306 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-73b6aad3-ce30-4b51-a3fd-0207d79e40ef tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:37.065323 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-73b6aad3-ce30-4b51-a3fd-0207d79e40ef tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:37.073697 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-73b6aad3-ce30-4b51-a3fd-0207d79e40ef tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:37.075379 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-73b6aad3-ce30-4b51-a3fd-0207d79e40ef tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:37.076540 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-73b6aad3-ce30-4b51-a3fd-0207d79e40ef tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1808 microversion: 2.20 time: 0.156026 Jun 03 10:01:37.077094 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 325/614] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:36 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:37.289239 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-0d9b1d24-1835-439d-a480-01c203d801dd tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:37.289907 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-0d9b1d24-1835-439d-a480-01c203d801dd tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:37.297085 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0d9b1d24-1835-439d-a480-01c203d801dd tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:37.297538 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0d9b1d24-1835-439d-a480-01c203d801dd tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:37.298613 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0d9b1d24-1835-439d-a480-01c203d801dd tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:37.299086 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0d9b1d24-1835-439d-a480-01c203d801dd tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:37.428386 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-22c48f19-50e4-448e-972c-9b9a3fcf1d7c tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:37.429052 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-22c48f19-50e4-448e-972c-9b9a3fcf1d7c tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:37.435496 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-22c48f19-50e4-448e-972c-9b9a3fcf1d7c tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:37.435947 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-22c48f19-50e4-448e-972c-9b9a3fcf1d7c tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:37.436709 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-22c48f19-50e4-448e-972c-9b9a3fcf1d7c tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:37.437148 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-22c48f19-50e4-448e-972c-9b9a3fcf1d7c tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:37.443830 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-0d9b1d24-1835-439d-a480-01c203d801dd tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:37.452060 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-0d9b1d24-1835-439d-a480-01c203d801dd tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1753 microversion: 2.1 time: 0.166357 Jun 03 10:01:37.452314 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 290/615] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:37 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:37.567704 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-22c48f19-50e4-448e-972c-9b9a3fcf1d7c tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:37.575190 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-22c48f19-50e4-448e-972c-9b9a3fcf1d7c tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1260 microversion: 2.1 time: 0.150667 Jun 03 10:01:37.575757 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 326/616] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:37 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:01:37.685174 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-3148e4a7-a68b-4d92-a032-573ce465889b tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:37.685813 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-3148e4a7-a68b-4d92-a032-573ce465889b tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:37.692334 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3148e4a7-a68b-4d92-a032-573ce465889b tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:37.692777 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3148e4a7-a68b-4d92-a032-573ce465889b tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:37.693532 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3148e4a7-a68b-4d92-a032-573ce465889b tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:37.693994 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3148e4a7-a68b-4d92-a032-573ce465889b tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:37.726518 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-21105b74-3ce4-46e1-b1b3-5d51e6d3e270 req-62ac9cbc-410c-4026-b25d-794c3e96d921 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a0aa280-d0b4-42e3-8dd4-e222a70d0f10", "name": "network-vif-plugged", "status": "completed", "tag": "11ea2cd5-6468-4db5-8bec-8a0e6b1acff8"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:01:37.734547 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-21105b74-3ce4-46e1-b1b3-5d51e6d3e270 req-62ac9cbc-410c-4026-b25d-794c3e96d921 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:37.735081 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-21105b74-3ce4-46e1-b1b3-5d51e6d3e270 req-62ac9cbc-410c-4026-b25d-794c3e96d921 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:37.745848 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-21105b74-3ce4-46e1-b1b3-5d51e6d3e270 req-62ac9cbc-410c-4026-b25d-794c3e96d921 service nova] Creating event network-vif-plugged:11ea2cd5-6468-4db5-8bec-8a0e6b1acff8 for instance 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 on hv-cinder-79760 Jun 03 10:01:37.751300 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-21105b74-3ce4-46e1-b1b3-5d51e6d3e270 req-62ac9cbc-410c-4026-b25d-794c3e96d921 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028271 Jun 03 10:01:37.752164 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 327/617] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 10:01:37.827085 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-3148e4a7-a68b-4d92-a032-573ce465889b tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:37.835534 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-3148e4a7-a68b-4d92-a032-573ce465889b tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6" status: 200 len: 1734 microversion: 2.1 time: 0.154143 Jun 03 10:01:37.836092 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 291/618] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:37 2022] GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:38.095367 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-af333219-cb71-4482-aab0-83dd2e30cd48 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:38.096008 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-af333219-cb71-4482-aab0-83dd2e30cd48 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:38.102283 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-af333219-cb71-4482-aab0-83dd2e30cd48 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:38.102729 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-af333219-cb71-4482-aab0-83dd2e30cd48 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:38.103491 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-af333219-cb71-4482-aab0-83dd2e30cd48 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:38.103926 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-af333219-cb71-4482-aab0-83dd2e30cd48 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:38.232624 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-af333219-cb71-4482-aab0-83dd2e30cd48 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:38.241469 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-af333219-cb71-4482-aab0-83dd2e30cd48 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:38.243012 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-af333219-cb71-4482-aab0-83dd2e30cd48 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:38.244167 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-af333219-cb71-4482-aab0-83dd2e30cd48 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1808 microversion: 2.20 time: 0.153116 Jun 03 10:01:38.244728 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 328/619] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:38 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:38.470349 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-777d0451-255e-4e1b-b838-a5e49c3b8a3b tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:38.470965 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-777d0451-255e-4e1b-b838-a5e49c3b8a3b tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:38.477489 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-777d0451-255e-4e1b-b838-a5e49c3b8a3b tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:38.477984 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-777d0451-255e-4e1b-b838-a5e49c3b8a3b tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:38.478747 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-777d0451-255e-4e1b-b838-a5e49c3b8a3b tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:38.479187 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-777d0451-255e-4e1b-b838-a5e49c3b8a3b tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:38.592523 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-af4c38f0-5b98-4efe-95bc-62b390eb3ab1 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:38.593771 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-af4c38f0-5b98-4efe-95bc-62b390eb3ab1 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:38.596438 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_api:SELECT=86 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:01:38.602121 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-af4c38f0-5b98-4efe-95bc-62b390eb3ab1 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:38.602968 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-af4c38f0-5b98-4efe-95bc-62b390eb3ab1 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:38.603495 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-af4c38f0-5b98-4efe-95bc-62b390eb3ab1 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:38.604335 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-af4c38f0-5b98-4efe-95bc-62b390eb3ab1 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:38.627860 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-777d0451-255e-4e1b-b838-a5e49c3b8a3b tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:38.639018 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-777d0451-255e-4e1b-b838-a5e49c3b8a3b tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1753 microversion: 2.1 time: 0.173085 Jun 03 10:01:38.641788 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 292/620] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:38 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1753 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:38.754536 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-af4c38f0-5b98-4efe-95bc-62b390eb3ab1 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:38.762557 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-af4c38f0-5b98-4efe-95bc-62b390eb3ab1 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1260 microversion: 2.1 time: 0.174374 Jun 03 10:01:38.763142 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 329/621] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:38 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:01:38.852235 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-94cf31da-ee18-4ef0-b74f-c1e89b7b317d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:38.853065 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-94cf31da-ee18-4ef0-b74f-c1e89b7b317d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:38.859661 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-94cf31da-ee18-4ef0-b74f-c1e89b7b317d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:38.860106 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-94cf31da-ee18-4ef0-b74f-c1e89b7b317d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:38.861059 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-94cf31da-ee18-4ef0-b74f-c1e89b7b317d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:38.861494 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-94cf31da-ee18-4ef0-b74f-c1e89b7b317d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:39.050020 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-94cf31da-ee18-4ef0-b74f-c1e89b7b317d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:39.058077 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-94cf31da-ee18-4ef0-b74f-c1e89b7b317d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6" status: 200 len: 1734 microversion: 2.1 time: 0.209669 Jun 03 10:01:39.058641 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 293/622] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:38 2022] GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 => generated 1734 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:39.262903 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-ba06fbdb-ea93-4f64-b4be-707a7452c73b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:39.263447 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-ba06fbdb-ea93-4f64-b4be-707a7452c73b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:39.270151 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ba06fbdb-ea93-4f64-b4be-707a7452c73b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:39.270557 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ba06fbdb-ea93-4f64-b4be-707a7452c73b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:39.271318 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ba06fbdb-ea93-4f64-b4be-707a7452c73b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:39.271752 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ba06fbdb-ea93-4f64-b4be-707a7452c73b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:39.396095 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-ba06fbdb-ea93-4f64-b4be-707a7452c73b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:39.404688 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-ba06fbdb-ea93-4f64-b4be-707a7452c73b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:39.406227 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-ba06fbdb-ea93-4f64-b4be-707a7452c73b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:39.407417 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-ba06fbdb-ea93-4f64-b4be-707a7452c73b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1808 microversion: 2.20 time: 0.148416 Jun 03 10:01:39.407976 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 330/623] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:39 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1808 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:39.658064 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-58b7f767-7082-48b5-834a-a7488511ebc0 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:39.658606 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-58b7f767-7082-48b5-834a-a7488511ebc0 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:39.665294 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-58b7f767-7082-48b5-834a-a7488511ebc0 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:39.665736 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-58b7f767-7082-48b5-834a-a7488511ebc0 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:39.666513 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-58b7f767-7082-48b5-834a-a7488511ebc0 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:39.666942 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-58b7f767-7082-48b5-834a-a7488511ebc0 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:39.777884 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-647f0c64-1fe1-4d7d-8fd1-1a95a84f3a86 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:39.778499 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-647f0c64-1fe1-4d7d-8fd1-1a95a84f3a86 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:39.785487 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-647f0c64-1fe1-4d7d-8fd1-1a95a84f3a86 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:39.785997 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-647f0c64-1fe1-4d7d-8fd1-1a95a84f3a86 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:39.786768 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-647f0c64-1fe1-4d7d-8fd1-1a95a84f3a86 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:39.787207 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-647f0c64-1fe1-4d7d-8fd1-1a95a84f3a86 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:39.816888 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-58b7f767-7082-48b5-834a-a7488511ebc0 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:39.825134 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-58b7f767-7082-48b5-834a-a7488511ebc0 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1753 microversion: 2.1 time: 0.170970 Jun 03 10:01:39.825717 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 294/624] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:39 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1753 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:39.919683 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-647f0c64-1fe1-4d7d-8fd1-1a95a84f3a86 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:39.929621 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-647f0c64-1fe1-4d7d-8fd1-1a95a84f3a86 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1260 microversion: 2.1 time: 0.155438 Jun 03 10:01:39.930650 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 331/625] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:39 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:01:40.075335 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-c16d1f92-fe83-4c1f-9106-0526fd2de3a8 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:40.075952 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-c16d1f92-fe83-4c1f-9106-0526fd2de3a8 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:40.082058 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c16d1f92-fe83-4c1f-9106-0526fd2de3a8 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:40.082513 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c16d1f92-fe83-4c1f-9106-0526fd2de3a8 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:40.083285 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c16d1f92-fe83-4c1f-9106-0526fd2de3a8 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:40.083725 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c16d1f92-fe83-4c1f-9106-0526fd2de3a8 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:40.210330 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-c16d1f92-fe83-4c1f-9106-0526fd2de3a8 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:40.218972 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-c16d1f92-fe83-4c1f-9106-0526fd2de3a8 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6" status: 200 len: 1734 microversion: 2.1 time: 0.146978 Jun 03 10:01:40.219544 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 295/626] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:40 2022] GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:40.425857 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-d40ca281-4799-44d1-91bf-4c865ab607f5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:40.426474 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-d40ca281-4799-44d1-91bf-4c865ab607f5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:40.432626 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d40ca281-4799-44d1-91bf-4c865ab607f5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:40.433087 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d40ca281-4799-44d1-91bf-4c865ab607f5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:40.433882 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d40ca281-4799-44d1-91bf-4c865ab607f5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:40.434358 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d40ca281-4799-44d1-91bf-4c865ab607f5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:40.559974 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-d40ca281-4799-44d1-91bf-4c865ab607f5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:40.568198 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-d40ca281-4799-44d1-91bf-4c865ab607f5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:40.569700 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-d40ca281-4799-44d1-91bf-4c865ab607f5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:40.570883 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-d40ca281-4799-44d1-91bf-4c865ab607f5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1795 microversion: 2.20 time: 0.149000 Jun 03 10:01:40.571441 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 332/627] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:01:40 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1795 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:01:40.842472 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-17c3e638-65d7-480e-8390-b5c5d46699ba tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:40.843011 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-17c3e638-65d7-480e-8390-b5c5d46699ba tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:40.849479 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-17c3e638-65d7-480e-8390-b5c5d46699ba tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:40.849978 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-17c3e638-65d7-480e-8390-b5c5d46699ba tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:40.850746 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-17c3e638-65d7-480e-8390-b5c5d46699ba tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:40.851182 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-17c3e638-65d7-480e-8390-b5c5d46699ba tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:40.947191 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-66006f41-6771-4167-932e-cf79e2db421e tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:40.947828 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-66006f41-6771-4167-932e-cf79e2db421e tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:40.959646 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-66006f41-6771-4167-932e-cf79e2db421e tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:40.963936 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-66006f41-6771-4167-932e-cf79e2db421e tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:40.964769 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-66006f41-6771-4167-932e-cf79e2db421e tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:40.965215 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-66006f41-6771-4167-932e-cf79e2db421e tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:41.003640 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-17c3e638-65d7-480e-8390-b5c5d46699ba tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:41.013628 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-17c3e638-65d7-480e-8390-b5c5d46699ba tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1756 microversion: 2.1 time: 0.174985 Jun 03 10:01:41.014500 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 296/628] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:40 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:41.168738 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-66006f41-6771-4167-932e-cf79e2db421e tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:41.176753 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-66006f41-6771-4167-932e-cf79e2db421e tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1260 microversion: 2.1 time: 0.233563 Jun 03 10:01:41.177528 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 333/629] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:40 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1260 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:41.236643 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-053c9ad9-1e82-4137-a0d7-17835c0f5ddb tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:41.237249 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-053c9ad9-1e82-4137-a0d7-17835c0f5ddb tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:41.243292 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-053c9ad9-1e82-4137-a0d7-17835c0f5ddb tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:41.243744 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-053c9ad9-1e82-4137-a0d7-17835c0f5ddb tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:41.244506 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-053c9ad9-1e82-4137-a0d7-17835c0f5ddb tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:41.244952 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-053c9ad9-1e82-4137-a0d7-17835c0f5ddb tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:41.369390 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-053c9ad9-1e82-4137-a0d7-17835c0f5ddb tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:41.371732 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:01:41.379343 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-053c9ad9-1e82-4137-a0d7-17835c0f5ddb tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6" status: 200 len: 1734 microversion: 2.1 time: 0.147247 Jun 03 10:01:41.379919 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 297/630] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:41 2022] GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:42.193879 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-25db7e81-f168-4a9a-bce1-f9ed70c58ca4 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:42.194533 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-25db7e81-f168-4a9a-bce1-f9ed70c58ca4 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:42.201130 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-25db7e81-f168-4a9a-bce1-f9ed70c58ca4 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:42.201582 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-25db7e81-f168-4a9a-bce1-f9ed70c58ca4 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:42.202383 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-25db7e81-f168-4a9a-bce1-f9ed70c58ca4 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:42.202824 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-25db7e81-f168-4a9a-bce1-f9ed70c58ca4 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:42.206816 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=100 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:01:42.333980 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-25db7e81-f168-4a9a-bce1-f9ed70c58ca4 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:42.341355 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-25db7e81-f168-4a9a-bce1-f9ed70c58ca4 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1260 microversion: 2.1 time: 0.151332 Jun 03 10:01:42.341941 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 334/631] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:42 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:42.396168 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-f9623100-f486-446a-8803-6e0e65f809a3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:42.396783 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-f9623100-f486-446a-8803-6e0e65f809a3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:42.403855 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f9623100-f486-446a-8803-6e0e65f809a3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:42.404304 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f9623100-f486-446a-8803-6e0e65f809a3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:42.405072 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f9623100-f486-446a-8803-6e0e65f809a3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:42.405530 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f9623100-f486-446a-8803-6e0e65f809a3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:42.531246 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f9623100-f486-446a-8803-6e0e65f809a3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:42.539953 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-f9623100-f486-446a-8803-6e0e65f809a3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6" status: 200 len: 1734 microversion: 2.1 time: 0.147620 Jun 03 10:01:42.540511 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 298/632] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:42 2022] GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:43.358640 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-20c351dc-bcab-4422-9315-da4d61537c16 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:43.359247 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-20c351dc-bcab-4422-9315-da4d61537c16 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:43.366712 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-20c351dc-bcab-4422-9315-da4d61537c16 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:43.366840 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-20c351dc-bcab-4422-9315-da4d61537c16 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:43.367866 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-20c351dc-bcab-4422-9315-da4d61537c16 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:43.368385 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-20c351dc-bcab-4422-9315-da4d61537c16 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:43.496281 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-20c351dc-bcab-4422-9315-da4d61537c16 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:43.503621 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-20c351dc-bcab-4422-9315-da4d61537c16 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1260 microversion: 2.1 time: 0.148768 Jun 03 10:01:43.504173 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 335/633] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:43 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:43.557835 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-73fc60ea-f18f-44ed-b41a-0a8af779c061 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:43.558448 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-73fc60ea-f18f-44ed-b41a-0a8af779c061 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:43.564663 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-73fc60ea-f18f-44ed-b41a-0a8af779c061 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:43.565143 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-73fc60ea-f18f-44ed-b41a-0a8af779c061 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:43.565935 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-73fc60ea-f18f-44ed-b41a-0a8af779c061 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:43.566374 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-73fc60ea-f18f-44ed-b41a-0a8af779c061 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:43.696712 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-73fc60ea-f18f-44ed-b41a-0a8af779c061 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:43.705494 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-73fc60ea-f18f-44ed-b41a-0a8af779c061 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6" status: 200 len: 1734 microversion: 2.1 time: 0.151503 Jun 03 10:01:43.706098 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 299/634] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:43 2022] GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:44.520231 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-02c1cf9e-aef4-4446-b153-691a920061f9 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:44.520848 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-02c1cf9e-aef4-4446-b153-691a920061f9 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:44.527755 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-02c1cf9e-aef4-4446-b153-691a920061f9 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:44.528206 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-02c1cf9e-aef4-4446-b153-691a920061f9 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:44.528984 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-02c1cf9e-aef4-4446-b153-691a920061f9 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:44.529423 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-02c1cf9e-aef4-4446-b153-691a920061f9 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:44.662349 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-02c1cf9e-aef4-4446-b153-691a920061f9 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:44.670265 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-02c1cf9e-aef4-4446-b153-691a920061f9 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1445 microversion: 2.1 time: 0.153799 Jun 03 10:01:44.670836 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 336/635] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:44 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1445 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:44.686578 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-a24dae35-3cd8-41f8-8229-4fa84fea02a8 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:44.687253 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-a24dae35-3cd8-41f8-8229-4fa84fea02a8 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:44.696053 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a24dae35-3cd8-41f8-8229-4fa84fea02a8 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:44.696480 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a24dae35-3cd8-41f8-8229-4fa84fea02a8 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:44.697252 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a24dae35-3cd8-41f8-8229-4fa84fea02a8 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:44.697687 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a24dae35-3cd8-41f8-8229-4fa84fea02a8 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:44.722699 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-e8e9ba7c-c530-4593-a260-78e163a2b9ba tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:44.723319 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-e8e9ba7c-c530-4593-a260-78e163a2b9ba tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:44.729369 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e8e9ba7c-c530-4593-a260-78e163a2b9ba tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:44.729866 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e8e9ba7c-c530-4593-a260-78e163a2b9ba tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:44.730640 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e8e9ba7c-c530-4593-a260-78e163a2b9ba tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:44.731079 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e8e9ba7c-c530-4593-a260-78e163a2b9ba tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:44.897521 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-a24dae35-3cd8-41f8-8229-4fa84fea02a8 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:44.901429 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-e8e9ba7c-c530-4593-a260-78e163a2b9ba tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:44.905215 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-a24dae35-3cd8-41f8-8229-4fa84fea02a8 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1445 microversion: 2.1 time: 0.222400 Jun 03 10:01:44.906385 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 300/636] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:44 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1445 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:44.910287 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-e8e9ba7c-c530-4593-a260-78e163a2b9ba tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6" status: 200 len: 1734 microversion: 2.1 time: 0.191921 Jun 03 10:01:44.910788 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 337/637] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:44 2022] GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 => generated 1734 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:45.926975 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-1fce0895-aa53-4c34-bf11-c52502eaab02 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:45.927573 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-1fce0895-aa53-4c34-bf11-c52502eaab02 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:45.929882 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:01:45.936289 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1fce0895-aa53-4c34-bf11-c52502eaab02 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:45.936974 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1fce0895-aa53-4c34-bf11-c52502eaab02 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:45.938130 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1fce0895-aa53-4c34-bf11-c52502eaab02 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:45.938561 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1fce0895-aa53-4c34-bf11-c52502eaab02 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:46.244621 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-1fce0895-aa53-4c34-bf11-c52502eaab02 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:46.254318 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-1fce0895-aa53-4c34-bf11-c52502eaab02 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6" status: 200 len: 1734 microversion: 2.1 time: 0.331265 Jun 03 10:01:46.254901 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 301/638] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:45 2022] GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 => generated 1734 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:46.796983 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-a7c6a980-5969-4cac-ab04-e214f653704b req-75e08e17-bdf8-4a93-93c5-98b0cfe9d868 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a0aa280-d0b4-42e3-8dd4-e222a70d0f10", "tag": "11ea2cd5-6468-4db5-8bec-8a0e6b1acff8"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:01:46.805610 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-a7c6a980-5969-4cac-ab04-e214f653704b req-75e08e17-bdf8-4a93-93c5-98b0cfe9d868 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:46.806149 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-a7c6a980-5969-4cac-ab04-e214f653704b req-75e08e17-bdf8-4a93-93c5-98b0cfe9d868 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:46.817732 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-a7c6a980-5969-4cac-ab04-e214f653704b req-75e08e17-bdf8-4a93-93c5-98b0cfe9d868 service nova] Creating event network-changed:11ea2cd5-6468-4db5-8bec-8a0e6b1acff8 for instance 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 on hv-cinder-79760 Jun 03 10:01:46.822828 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-a7c6a980-5969-4cac-ab04-e214f653704b req-75e08e17-bdf8-4a93-93c5-98b0cfe9d868 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029553 Jun 03 10:01:46.823506 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 338/639] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:01:47.271188 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-88cdedf5-77ef-4c1d-95eb-100c31c674ce tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:47.272547 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-88cdedf5-77ef-4c1d-95eb-100c31c674ce tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:47.279491 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-88cdedf5-77ef-4c1d-95eb-100c31c674ce tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:47.280292 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-88cdedf5-77ef-4c1d-95eb-100c31c674ce tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:47.281144 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-88cdedf5-77ef-4c1d-95eb-100c31c674ce tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:47.281657 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-88cdedf5-77ef-4c1d-95eb-100c31c674ce tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:47.416476 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-88cdedf5-77ef-4c1d-95eb-100c31c674ce tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:47.426068 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-88cdedf5-77ef-4c1d-95eb-100c31c674ce tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6" status: 200 len: 1734 microversion: 2.1 time: 0.158563 Jun 03 10:01:47.426801 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 302/640] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:47 2022] GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:48.443897 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-33057646-53af-4904-91ff-de3145ded833 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:48.444607 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-33057646-53af-4904-91ff-de3145ded833 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:48.450915 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-33057646-53af-4904-91ff-de3145ded833 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:48.451371 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-33057646-53af-4904-91ff-de3145ded833 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:48.452140 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-33057646-53af-4904-91ff-de3145ded833 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:48.452582 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-33057646-53af-4904-91ff-de3145ded833 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:48.587118 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-33057646-53af-4904-91ff-de3145ded833 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:48.595806 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-33057646-53af-4904-91ff-de3145ded833 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6" status: 200 len: 1734 microversion: 2.1 time: 0.156790 Jun 03 10:01:48.596492 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 339/641] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:48 2022] GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:49.613505 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-d5d56ff7-44e1-46ed-90c3-869000544801 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:49.614147 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-d5d56ff7-44e1-46ed-90c3-869000544801 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:49.620641 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d5d56ff7-44e1-46ed-90c3-869000544801 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:49.621094 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d5d56ff7-44e1-46ed-90c3-869000544801 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:49.621880 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d5d56ff7-44e1-46ed-90c3-869000544801 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:49.622319 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d5d56ff7-44e1-46ed-90c3-869000544801 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:49.750609 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d5d56ff7-44e1-46ed-90c3-869000544801 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:49.758577 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-d5d56ff7-44e1-46ed-90c3-869000544801 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6" status: 200 len: 1734 microversion: 2.1 time: 0.148917 Jun 03 10:01:49.759134 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 303/642] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:49 2022] GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:50.775799 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-5eeef920-6fb5-457e-b050-78bffb01b728 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:50.776404 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-5eeef920-6fb5-457e-b050-78bffb01b728 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:50.783049 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5eeef920-6fb5-457e-b050-78bffb01b728 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:50.783496 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5eeef920-6fb5-457e-b050-78bffb01b728 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:50.784516 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5eeef920-6fb5-457e-b050-78bffb01b728 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:50.784946 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5eeef920-6fb5-457e-b050-78bffb01b728 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:50.921388 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-5eeef920-6fb5-457e-b050-78bffb01b728 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:50.929323 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-5eeef920-6fb5-457e-b050-78bffb01b728 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6" status: 200 len: 1734 microversion: 2.1 time: 0.157554 Jun 03 10:01:50.929897 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 340/643] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:50 2022] GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:51.946535 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-c05907fc-d7fd-4f77-8028-4bcbf3cb936e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:51.947172 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-c05907fc-d7fd-4f77-8028-4bcbf3cb936e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:51.953863 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c05907fc-d7fd-4f77-8028-4bcbf3cb936e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:51.954317 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c05907fc-d7fd-4f77-8028-4bcbf3cb936e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:51.955084 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c05907fc-d7fd-4f77-8028-4bcbf3cb936e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:51.955523 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c05907fc-d7fd-4f77-8028-4bcbf3cb936e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:52.081073 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-c05907fc-d7fd-4f77-8028-4bcbf3cb936e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:52.088985 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-c05907fc-d7fd-4f77-8028-4bcbf3cb936e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6" status: 200 len: 1734 microversion: 2.1 time: 0.146313 Jun 03 10:01:52.089551 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 304/644] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:51 2022] GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 => generated 1734 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:53.106038 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-d4801cb9-cb90-453a-9024-45d6c7307875 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:53.106577 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-d4801cb9-cb90-453a-9024-45d6c7307875 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:53.113612 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d4801cb9-cb90-453a-9024-45d6c7307875 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:53.114100 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d4801cb9-cb90-453a-9024-45d6c7307875 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:53.114864 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d4801cb9-cb90-453a-9024-45d6c7307875 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:53.115300 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d4801cb9-cb90-453a-9024-45d6c7307875 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:53.242215 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-d4801cb9-cb90-453a-9024-45d6c7307875 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:53.251365 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-d4801cb9-cb90-453a-9024-45d6c7307875 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6" status: 200 len: 1734 microversion: 2.1 time: 0.149145 Jun 03 10:01:53.252253 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 341/645] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:53 2022] GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:54.268200 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-07ca04c2-8503-4e03-a51b-5bfae90eabd5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:54.268807 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-07ca04c2-8503-4e03-a51b-5bfae90eabd5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:54.275323 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-07ca04c2-8503-4e03-a51b-5bfae90eabd5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:54.275762 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-07ca04c2-8503-4e03-a51b-5bfae90eabd5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:54.276513 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-07ca04c2-8503-4e03-a51b-5bfae90eabd5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:54.276943 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-07ca04c2-8503-4e03-a51b-5bfae90eabd5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:54.409467 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-07ca04c2-8503-4e03-a51b-5bfae90eabd5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:54.417320 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-07ca04c2-8503-4e03-a51b-5bfae90eabd5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6" status: 200 len: 1714 microversion: 2.1 time: 0.153504 Jun 03 10:01:54.417902 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 305/646] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:54 2022] GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 => generated 1714 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:54.470577 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-5b4dba99-67f7-483e-8e77-d180cd8b5592 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:54.471115 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-5b4dba99-67f7-483e-8e77-d180cd8b5592 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:54.477721 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5b4dba99-67f7-483e-8e77-d180cd8b5592 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:54.478204 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5b4dba99-67f7-483e-8e77-d180cd8b5592 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:54.478997 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5b4dba99-67f7-483e-8e77-d180cd8b5592 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:54.479433 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5b4dba99-67f7-483e-8e77-d180cd8b5592 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:54.599295 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.wsgi [None req-5b4dba99-67f7-483e-8e77-d180cd8b5592 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] HTTP exception thrown: Cannot 'detach_volume' instance fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 while it is in vm_state rescued Jun 03 10:01:54.600902 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-5b4dba99-67f7-483e-8e77-d180cd8b5592 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Request method failure captured: Jun 03 10:01:54.600902 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: request: DELETE /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6/os-volume_attachments/85398176-4b7b-4cdb-ae84-f80a34a24072 HTTP/1.1 Jun 03 10:01:54.600902 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Accept: application/json Jun 03 10:01:54.600902 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Accept-Encoding: identity Jun 03 10:01:54.600902 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Connection: close Jun 03 10:01:54.600902 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Content-Length: 0 Jun 03 10:01:54.600902 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Content-Type: application/json Jun 03 10:01:54.600902 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Host: 10.222.0.45 Jun 03 10:01:54.600902 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Openstack-System-Scope: None Jun 03 10:01:54.600902 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: User-Agent: python-urllib3/1.26.9 Jun 03 10:01:54.600902 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Auth-Token: gAAAAABimdrfigAOeRL39EQeU8ft5oLHphkLgyvfXeq689r-FPCTJ4y9syXd_Jkm2SUwfkUx56Vaw5Abp0MA7ys2jMe9OzXPF0y6W0tmgHeUN9HmnC9ZvPbEkqx3KEqP4SzVqBlhmk1rpSp0EIzVbucLMiRYAGSLn3O0Lqt3BpdZ6R8sppypbLw Jun 03 10:01:54.600902 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Domain-Id: None Jun 03 10:01:54.600902 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Domain-Name: None Jun 03 10:01:54.600902 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Identity-Status: Confirmed Jun 03 10:01:54.600902 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Is-Admin-Project: True Jun 03 10:01:54.600902 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Domain-Id: default Jun 03 10:01:54.600902 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Domain-Name: Default Jun 03 10:01:54.600902 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Id: b96e7e1b09a04adbba3bd083328ecb71 Jun 03 10:01:54.600902 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-631686423 Jun 03 10:01:54.600902 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Role: member,reader Jun 03 10:01:54.600902 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Roles: member,reader Jun 03 10:01:54.602506 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b96e7e1b09a04adbba3bd083328ecb71", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b96e7e1b09a04adbba3bd083328ecb71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b96e7e1b09a04adbba3bd083328ecb71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b96e7e1b09a04adbba3bd083328ecb71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 10:01:54.602506 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant: tempest-ServerRescueNegativeTestJSON-631686423 Jun 03 10:01:54.602506 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant-Id: b96e7e1b09a04adbba3bd083328ecb71 Jun 03 10:01:54.602506 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-631686423 Jun 03 10:01:54.602506 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User: tempest-ServerRescueNegativeTestJSON-631686423-project Jun 03 10:01:54.602506 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Domain-Id: default Jun 03 10:01:54.602506 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Domain-Name: Default Jun 03 10:01:54.602506 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Id: d547e64bcf5d4799af6039df3c9a4ea6 Jun 03 10:01:54.602506 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Name: tempest-ServerRescueNegativeTestJSON-631686423-project Jun 03 10:01:54.602506 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: method: > Jun 03 10:01:54.602506 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: exception: Cannot 'detach_volume' instance fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 while it is in vm_state rescued Jun 03 10:01:54.603347 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: action_args: {'server_id': 'fd6f7d78-98ab-4e91-83cd-fae19bd9bae6', 'id': '85398176-4b7b-4cdb-ae84-f80a34a24072'} Jun 03 10:01:54.603347 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:01:54.603347 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:01:54.603347 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 03 10:01:54.603347 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 03 10:01:54.603347 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 03 10:01:54.603347 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 03 10:01:54.603347 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 03 10:01:54.603347 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 03 10:01:54.603347 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 03 10:01:54.603347 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:01:54.603347 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:01:54.603347 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:01:54.603347 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:01:54.603347 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:01:54.603347 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:01:54.603347 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:01:54.603347 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:01:54.603347 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:01:54.603347 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:01:54.604681 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 03 10:01:54.604681 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 03 10:01:54.604681 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 03 10:01:54.604681 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 03 10:01:54.604681 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 while it is in vm_state rescued Jun 03 10:01:54.604681 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:01:54.604681 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:01:54.604681 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:01:54.604681 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:01:54.604681 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:01:54.604681 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:01:54.604681 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:01:54.604681 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:01:54.604681 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 while it is in vm_state rescued Jun 03 10:01:54.604681 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:01:54.604681 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-5b4dba99-67f7-483e-8e77-d180cd8b5592 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Returning 409 to user: Cannot 'detach_volume' instance fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 while it is in vm_state rescued {{(pid=117647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:01:54.605652 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-5b4dba99-67f7-483e-8e77-d180cd8b5592 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "DELETE /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6/os-volume_attachments/85398176-4b7b-4cdb-ae84-f80a34a24072" status: 409 len: 152 microversion: 2.1 time: 0.135767 Jun 03 10:01:54.605652 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 342/647] 10.222.0.45 () {58 vars in 1415 bytes} [Fri Jun 3 10:01:54 2022] DELETE /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6/os-volume_attachments/85398176-4b7b-4cdb-ae84-f80a34a24072 => generated 152 bytes in 137 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 03 10:01:54.611716 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-b844de72-5945-4451-800b-abbfc9155965 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:01:54.612242 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-b844de72-5945-4451-800b-abbfc9155965 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:54.618095 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b844de72-5945-4451-800b-abbfc9155965 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:54.618537 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b844de72-5945-4451-800b-abbfc9155965 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:54.619284 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b844de72-5945-4451-800b-abbfc9155965 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:54.619708 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b844de72-5945-4451-800b-abbfc9155965 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:54.684283 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-b844de72-5945-4451-800b-abbfc9155965 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "POST /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6/action" status: 202 len: 0 microversion: 2.1 time: 0.076662 Jun 03 10:01:54.684905 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 306/648] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jun 3 10:01:54 2022] POST /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 10:01:54.693543 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-59cdb187-f830-4aa2-91ee-fc41b0d3cea0 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:54.694191 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-59cdb187-f830-4aa2-91ee-fc41b0d3cea0 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:54.701027 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-59cdb187-f830-4aa2-91ee-fc41b0d3cea0 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:54.701506 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-59cdb187-f830-4aa2-91ee-fc41b0d3cea0 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:54.702297 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-59cdb187-f830-4aa2-91ee-fc41b0d3cea0 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:54.702742 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-59cdb187-f830-4aa2-91ee-fc41b0d3cea0 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:54.829503 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-59cdb187-f830-4aa2-91ee-fc41b0d3cea0 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:54.837619 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-59cdb187-f830-4aa2-91ee-fc41b0d3cea0 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6" status: 200 len: 1722 microversion: 2.1 time: 0.147707 Jun 03 10:01:54.838173 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 343/649] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:54 2022] GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:55.855950 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-1819cc35-4826-4435-9512-d294694f6656 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:55.856687 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-1819cc35-4826-4435-9512-d294694f6656 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:55.863093 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1819cc35-4826-4435-9512-d294694f6656 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:55.863552 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1819cc35-4826-4435-9512-d294694f6656 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:55.864329 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1819cc35-4826-4435-9512-d294694f6656 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:55.864774 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1819cc35-4826-4435-9512-d294694f6656 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:55.998306 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-1819cc35-4826-4435-9512-d294694f6656 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:56.006914 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-1819cc35-4826-4435-9512-d294694f6656 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6" status: 200 len: 1722 microversion: 2.1 time: 0.155604 Jun 03 10:01:56.007489 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 307/650] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:55 2022] GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:57.024439 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-fe62081f-3950-4b03-859a-85b5d24136ad tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:57.025050 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-fe62081f-3950-4b03-859a-85b5d24136ad tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:57.032120 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-fe62081f-3950-4b03-859a-85b5d24136ad tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:57.032563 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-fe62081f-3950-4b03-859a-85b5d24136ad tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:57.033321 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-fe62081f-3950-4b03-859a-85b5d24136ad tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:57.033769 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-fe62081f-3950-4b03-859a-85b5d24136ad tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:57.163508 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-fe62081f-3950-4b03-859a-85b5d24136ad tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:57.172184 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-fe62081f-3950-4b03-859a-85b5d24136ad tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6" status: 200 len: 1722 microversion: 2.1 time: 0.151580 Jun 03 10:01:57.172747 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 344/651] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:57 2022] GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:58.189325 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-e0caa09a-80b4-4a32-85d9-aff5ced95de4 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:58.189981 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-e0caa09a-80b4-4a32-85d9-aff5ced95de4 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:58.196860 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e0caa09a-80b4-4a32-85d9-aff5ced95de4 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:58.197309 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e0caa09a-80b4-4a32-85d9-aff5ced95de4 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:58.198097 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e0caa09a-80b4-4a32-85d9-aff5ced95de4 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:58.198534 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e0caa09a-80b4-4a32-85d9-aff5ced95de4 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:58.330310 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-e0caa09a-80b4-4a32-85d9-aff5ced95de4 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:58.338201 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-e0caa09a-80b4-4a32-85d9-aff5ced95de4 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6" status: 200 len: 1722 microversion: 2.1 time: 0.152730 Jun 03 10:01:58.338768 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 308/652] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:58 2022] GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:59.356093 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-80fee17e-66e6-4671-b238-a530c64cbaa5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:59.356609 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-80fee17e-66e6-4671-b238-a530c64cbaa5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:59.363851 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-80fee17e-66e6-4671-b238-a530c64cbaa5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:59.364306 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-80fee17e-66e6-4671-b238-a530c64cbaa5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:59.365078 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-80fee17e-66e6-4671-b238-a530c64cbaa5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:59.365524 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-80fee17e-66e6-4671-b238-a530c64cbaa5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:59.496433 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-80fee17e-66e6-4671-b238-a530c64cbaa5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:01:59.504303 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-80fee17e-66e6-4671-b238-a530c64cbaa5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6" status: 200 len: 1728 microversion: 2.1 time: 0.152221 Jun 03 10:01:59.504862 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 345/653] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:01:59 2022] GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:01:59.520551 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-aa4eed9e-05c7-4722-a7d1-96b540d26bf5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:01:59.521044 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-aa4eed9e-05c7-4722-a7d1-96b540d26bf5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:01:59.527530 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-aa4eed9e-05c7-4722-a7d1-96b540d26bf5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:59.527982 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-aa4eed9e-05c7-4722-a7d1-96b540d26bf5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:59.528746 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-aa4eed9e-05c7-4722-a7d1-96b540d26bf5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:01:59.529188 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-aa4eed9e-05c7-4722-a7d1-96b540d26bf5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:01:59.614109 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-aa4eed9e-05c7-4722-a7d1-96b540d26bf5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097286 Jun 03 10:01:59.614705 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 309/654] 10.222.0.45 () {58 vars in 1274 bytes} [Fri Jun 3 10:01:59 2022] GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:02:00.697011 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-fa08aa7d-d678-4f4f-9ee0-e7c08478d979 req-dfd33a39-35b5-43b1-990b-28d0c1e86f80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd6f7d78-98ab-4e91-83cd-fae19bd9bae6", "tag": "188b0350-b3f9-4bd3-92de-c42a02aaa09f"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:02:00.708843 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-fa08aa7d-d678-4f4f-9ee0-e7c08478d979 req-dfd33a39-35b5-43b1-990b-28d0c1e86f80 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:00.709433 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-fa08aa7d-d678-4f4f-9ee0-e7c08478d979 req-dfd33a39-35b5-43b1-990b-28d0c1e86f80 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:00.720850 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-fa08aa7d-d678-4f4f-9ee0-e7c08478d979 req-dfd33a39-35b5-43b1-990b-28d0c1e86f80 service nova] Creating event network-changed:188b0350-b3f9-4bd3-92de-c42a02aaa09f for instance fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 on hv-cinder-79760 Jun 03 10:02:00.726305 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-fa08aa7d-d678-4f4f-9ee0-e7c08478d979 req-dfd33a39-35b5-43b1-990b-28d0c1e86f80 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033602 Jun 03 10:02:00.726985 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 346/655] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:02:02.741650 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-6ce87268-ed2b-4fc4-8411-9cce5bbac7d5 req-f60b6f02-7f43-44eb-85e1-880247d50403 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd6f7d78-98ab-4e91-83cd-fae19bd9bae6", "tag": "188b0350-b3f9-4bd3-92de-c42a02aaa09f"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:02:02.750304 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-6ce87268-ed2b-4fc4-8411-9cce5bbac7d5 req-f60b6f02-7f43-44eb-85e1-880247d50403 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:02.750747 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-6ce87268-ed2b-4fc4-8411-9cce5bbac7d5 req-f60b6f02-7f43-44eb-85e1-880247d50403 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:02.761609 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-6ce87268-ed2b-4fc4-8411-9cce5bbac7d5 req-f60b6f02-7f43-44eb-85e1-880247d50403 service nova] Creating event network-changed:188b0350-b3f9-4bd3-92de-c42a02aaa09f for instance fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 on hv-cinder-79760 Jun 03 10:02:02.767050 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-6ce87268-ed2b-4fc4-8411-9cce5bbac7d5 req-f60b6f02-7f43-44eb-85e1-880247d50403 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029548 Jun 03 10:02:02.767613 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 310/656] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:02:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:02:03.037386 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-d8975841-ab7a-4983-9f9d-4a7ee41f9bca tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:03.038005 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-d8975841-ab7a-4983-9f9d-4a7ee41f9bca tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 2ecad1bf-3c89-4b29-a511-6e3d71a834fc] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:03.044196 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d8975841-ab7a-4983-9f9d-4a7ee41f9bca tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:03.044645 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d8975841-ab7a-4983-9f9d-4a7ee41f9bca tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:03.045513 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d8975841-ab7a-4983-9f9d-4a7ee41f9bca tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:03.046504 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d8975841-ab7a-4983-9f9d-4a7ee41f9bca tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:03.069624 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-d8975841-ab7a-4983-9f9d-4a7ee41f9bca tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc/ips" status: 200 len: 150 microversion: 2.1 time: 0.147063 Jun 03 10:02:03.070210 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 347/657] 10.222.0.45 () {58 vars in 1247 bytes} [Fri Jun 3 10:02:02 2022] GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc/ips => generated 150 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:02:03.081088 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-262a09d6-cebb-42ac-9786-04314d854241 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f8047f5e-515b-42fd-bd16-343ccd47c9e6"}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:02:03.082254 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-262a09d6-cebb-42ac-9786-04314d854241 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 2ecad1bf-3c89-4b29-a511-6e3d71a834fc] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:03.088860 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-262a09d6-cebb-42ac-9786-04314d854241 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:03.089289 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-262a09d6-cebb-42ac-9786-04314d854241 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:03.090199 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-262a09d6-cebb-42ac-9786-04314d854241 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:03.090628 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-262a09d6-cebb-42ac-9786-04314d854241 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:03.184898 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.wsgi [None req-262a09d6-cebb-42ac-9786-04314d854241 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] HTTP exception thrown: Invalid volume: volume f8047f5e-515b-42fd-bd16-343ccd47c9e6 is already attached to instances: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e Jun 03 10:02:03.187036 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-262a09d6-cebb-42ac-9786-04314d854241 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Request method failure captured: Jun 03 10:02:03.187036 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: request: POST /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc/os-volume_attachments HTTP/1.1 Jun 03 10:02:03.187036 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept: application/json Jun 03 10:02:03.187036 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept-Encoding: identity Jun 03 10:02:03.187036 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Connection: close Jun 03 10:02:03.187036 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Length: 74 Jun 03 10:02:03.187036 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Type: application/json Jun 03 10:02:03.187036 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Host: 10.222.0.45 Jun 03 10:02:03.187036 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Openstack-System-Scope: None Jun 03 10:02:03.187036 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: User-Agent: python-urllib3/1.26.9 Jun 03 10:02:03.187036 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Auth-Token: gAAAAABimdrmmGMJYoFEaixKtEm5TQ4XA5jgCy5iwX6ZjbOH9DxrKeyENuD4peBUKmdWr-PDWrDLYLLxy5lixGd2HlPi4aZlZBg9FmZSE7U7_CN_FIxjIovt53hs7DTTUFYYhZcU3_b0MiLpd7TSlEfGmsHpIrMSk9dkjlfpCuRH8mQ4nPiTBOs Jun 03 10:02:03.187036 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Id: None Jun 03 10:02:03.187036 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Name: None Jun 03 10:02:03.187036 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Identity-Status: Confirmed Jun 03 10:02:03.187036 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Is-Admin-Project: True Jun 03 10:02:03.187036 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Id: default Jun 03 10:02:03.187036 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Name: Default Jun 03 10:02:03.187036 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Id: 12d4ca628b894615bc311c3705c4a801 Jun 03 10:02:03.187036 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Name: tempest-AttachVolumeNegativeTest-1776358070 Jun 03 10:02:03.187036 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Role: member,reader Jun 03 10:02:03.187036 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Roles: member,reader Jun 03 10:02:03.190093 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_12d4ca628b894615bc311c3705c4a801", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/12d4ca628b894615bc311c3705c4a801"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/12d4ca628b894615bc311c3705c4a801"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/12d4ca628b894615bc311c3705c4a801"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 10:02:03.190093 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant: tempest-AttachVolumeNegativeTest-1776358070 Jun 03 10:02:03.190093 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Id: 12d4ca628b894615bc311c3705c4a801 Jun 03 10:02:03.190093 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1776358070 Jun 03 10:02:03.190093 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User: tempest-AttachVolumeNegativeTest-1776358070-project Jun 03 10:02:03.190093 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Id: default Jun 03 10:02:03.190093 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Name: Default Jun 03 10:02:03.190093 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Id: e62d9d781281497e9927c0eb0e85dd75 Jun 03 10:02:03.190093 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Name: tempest-AttachVolumeNegativeTest-1776358070-project Jun 03 10:02:03.190093 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Jun 03 10:02:03.190093 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: {"volumeAttachment": {"volumeId": "f8047f5e-515b-42fd-bd16-343ccd47c9e6"}} Jun 03 10:02:03.190093 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: method: > Jun 03 10:02:03.191615 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: exception: Invalid volume: volume f8047f5e-515b-42fd-bd16-343ccd47c9e6 is already attached to instances: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e Jun 03 10:02:03.191615 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: action_args: {'server_id': '2ecad1bf-3c89-4b29-a511-6e3d71a834fc', 'body': {'volumeAttachment': {'volumeId': 'f8047f5e-515b-42fd-bd16-343ccd47c9e6'}}} Jun 03 10:02:03.191615 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:02:03.191615 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:02:03.191615 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 03 10:02:03.191615 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 03 10:02:03.191615 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 03 10:02:03.191615 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 03 10:02:03.191615 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 03 10:02:03.191615 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 03 10:02:03.191615 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 03 10:02:03.191615 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 03 10:02:03.191615 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 03 10:02:03.191615 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 03 10:02:03.191615 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f8047f5e-515b-42fd-bd16-343ccd47c9e6 is already attached to instances: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e Jun 03 10:02:03.191615 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:02:03.191615 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:02:03.191615 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:02:03.191615 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:02:03.193015 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:02:03.193015 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:02:03.193015 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:02:03.193015 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:02:03.193015 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:02:03.193015 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:02:03.193015 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 10:02:03.193015 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 10:02:03.193015 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 10:02:03.193015 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 10:02:03.193015 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 10:02:03.193015 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 10:02:03.193015 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 03 10:02:03.193015 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 03 10:02:03.193015 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f8047f5e-515b-42fd-bd16-343ccd47c9e6 is already attached to instances: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e Jun 03 10:02:03.193015 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:02:03.193015 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:02:03.193015 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:02:03.193015 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:02:03.193015 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:02:03.194528 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:02:03.194528 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:02:03.194528 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:02:03.194528 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f8047f5e-515b-42fd-bd16-343ccd47c9e6 is already attached to instances: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e Jun 03 10:02:03.194528 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:02:03.194528 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-262a09d6-cebb-42ac-9786-04314d854241 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Returning 400 to user: Invalid volume: volume f8047f5e-515b-42fd-bd16-343ccd47c9e6 is already attached to instances: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e {{(pid=117648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:02:03.194528 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-262a09d6-cebb-42ac-9786-04314d854241 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "POST /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.112278 Jun 03 10:02:03.194528 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 311/658] 10.222.0.45 () {60 vars in 1322 bytes} [Fri Jun 3 10:02:03 2022] POST /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc/os-volume_attachments => generated 174 bytes in 114 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 03 10:02:03.201077 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-ad8a3cab-a0e9-466e-b9a7-50adca598187 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:03.201577 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-ad8a3cab-a0e9-466e-b9a7-50adca598187 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 2ecad1bf-3c89-4b29-a511-6e3d71a834fc] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:03.209352 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ad8a3cab-a0e9-466e-b9a7-50adca598187 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:03.209837 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ad8a3cab-a0e9-466e-b9a7-50adca598187 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:03.210616 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ad8a3cab-a0e9-466e-b9a7-50adca598187 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:03.211052 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ad8a3cab-a0e9-466e-b9a7-50adca598187 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:03.237874 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-ad8a3cab-a0e9-466e-b9a7-50adca598187 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 2ecad1bf-3c89-4b29-a511-6e3d71a834fc] Going to try to terminate instance {{(pid=117647) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 10:02:03.327476 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-ad8a3cab-a0e9-466e-b9a7-50adca598187 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "DELETE /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc" status: 204 len: 0 microversion: 2.1 time: 0.130196 Jun 03 10:02:03.328025 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 348/659] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jun 3 10:02:03 2022] DELETE /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 03 10:02:03.338404 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-34b5b184-980c-430f-b5e9-2ed12fa63b3f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:03.339055 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-34b5b184-980c-430f-b5e9-2ed12fa63b3f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 2ecad1bf-3c89-4b29-a511-6e3d71a834fc] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:03.347239 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-34b5b184-980c-430f-b5e9-2ed12fa63b3f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:03.347695 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-34b5b184-980c-430f-b5e9-2ed12fa63b3f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:03.348500 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-34b5b184-980c-430f-b5e9-2ed12fa63b3f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:03.348935 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-34b5b184-980c-430f-b5e9-2ed12fa63b3f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:03.498790 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-34b5b184-980c-430f-b5e9-2ed12fa63b3f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:03.506481 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-34b5b184-980c-430f-b5e9-2ed12fa63b3f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc" status: 200 len: 1680 microversion: 2.1 time: 0.174001 Jun 03 10:02:03.507041 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 312/660] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:03 2022] GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc => generated 1680 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:02:04.528668 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-36d0eef4-2481-439d-a05e-81fd88a0721d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:04.529375 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-36d0eef4-2481-439d-a05e-81fd88a0721d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 2ecad1bf-3c89-4b29-a511-6e3d71a834fc] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:04.536289 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-36d0eef4-2481-439d-a05e-81fd88a0721d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:04.536740 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-36d0eef4-2481-439d-a05e-81fd88a0721d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:04.537506 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-36d0eef4-2481-439d-a05e-81fd88a0721d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:04.537983 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-36d0eef4-2481-439d-a05e-81fd88a0721d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:04.667082 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-36d0eef4-2481-439d-a05e-81fd88a0721d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:04.674947 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-36d0eef4-2481-439d-a05e-81fd88a0721d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc" status: 200 len: 1680 microversion: 2.1 time: 0.151576 Jun 03 10:02:04.675501 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 349/661] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:04 2022] GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:05.692104 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-156632e3-d73a-498e-8516-d2286584ddc5 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:05.692742 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-156632e3-d73a-498e-8516-d2286584ddc5 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 2ecad1bf-3c89-4b29-a511-6e3d71a834fc] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:05.699327 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-156632e3-d73a-498e-8516-d2286584ddc5 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:05.699782 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-156632e3-d73a-498e-8516-d2286584ddc5 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:05.700560 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-156632e3-d73a-498e-8516-d2286584ddc5 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:05.701004 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-156632e3-d73a-498e-8516-d2286584ddc5 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:05.832948 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-156632e3-d73a-498e-8516-d2286584ddc5 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:05.840522 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-156632e3-d73a-498e-8516-d2286584ddc5 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc" status: 200 len: 1680 microversion: 2.1 time: 0.152308 Jun 03 10:02:05.841084 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 313/662] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:05 2022] GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:06.858203 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-b0ad7536-1b52-4cc2-a2de-0a35df4ecdba tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:06.859333 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-b0ad7536-1b52-4cc2-a2de-0a35df4ecdba tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 2ecad1bf-3c89-4b29-a511-6e3d71a834fc] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:06.865911 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b0ad7536-1b52-4cc2-a2de-0a35df4ecdba tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:06.866369 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b0ad7536-1b52-4cc2-a2de-0a35df4ecdba tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:06.867141 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b0ad7536-1b52-4cc2-a2de-0a35df4ecdba tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:06.867587 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b0ad7536-1b52-4cc2-a2de-0a35df4ecdba tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:07.005317 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-b0ad7536-1b52-4cc2-a2de-0a35df4ecdba tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:07.007689 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:02:07.014537 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-b0ad7536-1b52-4cc2-a2de-0a35df4ecdba tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc" status: 200 len: 1680 microversion: 2.1 time: 0.160189 Jun 03 10:02:07.015319 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 350/663] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:06 2022] GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:07.429620 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-557581cf-8cc8-4b82-b908-233be83a769b req-82ed40ca-6e79-4a1e-8059-1bed6fd2a163 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ecad1bf-3c89-4b29-a511-6e3d71a834fc", "name": "network-vif-deleted", "tag": "9e1af8da-841e-40c5-97a6-85870409a32f"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:02:07.438833 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-557581cf-8cc8-4b82-b908-233be83a769b req-82ed40ca-6e79-4a1e-8059-1bed6fd2a163 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:07.439479 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-557581cf-8cc8-4b82-b908-233be83a769b req-82ed40ca-6e79-4a1e-8059-1bed6fd2a163 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:07.453184 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-557581cf-8cc8-4b82-b908-233be83a769b req-82ed40ca-6e79-4a1e-8059-1bed6fd2a163 service nova] Creating event network-vif-deleted:9e1af8da-841e-40c5-97a6-85870409a32f for instance 2ecad1bf-3c89-4b29-a511-6e3d71a834fc on hv-cinder-79760 Jun 03 10:02:07.458331 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-557581cf-8cc8-4b82-b908-233be83a769b req-82ed40ca-6e79-4a1e-8059-1bed6fd2a163 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109613 Jun 03 10:02:07.463038 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 314/664] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:02:08.031827 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-4f18a6fa-e95a-428c-af3e-331ab1751145 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:08.032460 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-4f18a6fa-e95a-428c-af3e-331ab1751145 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 2ecad1bf-3c89-4b29-a511-6e3d71a834fc] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:08.040128 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4f18a6fa-e95a-428c-af3e-331ab1751145 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:08.040564 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4f18a6fa-e95a-428c-af3e-331ab1751145 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:08.041342 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4f18a6fa-e95a-428c-af3e-331ab1751145 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:08.041797 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4f18a6fa-e95a-428c-af3e-331ab1751145 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:08.075783 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4f18a6fa-e95a-428c-af3e-331ab1751145 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:08.076232 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4f18a6fa-e95a-428c-af3e-331ab1751145 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:08.077055 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.objects.instance [None req-4f18a6fa-e95a-428c-af3e-331ab1751145 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lazy-loading 'fault' on Instance uuid 2ecad1bf-3c89-4b29-a511-6e3d71a834fc {{(pid=117647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:02:08.122387 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-4f18a6fa-e95a-428c-af3e-331ab1751145 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:08.130883 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-4f18a6fa-e95a-428c-af3e-331ab1751145 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc" status: 200 len: 1330 microversion: 2.1 time: 0.103134 Jun 03 10:02:08.133872 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 351/665] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:08 2022] GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc => generated 1330 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:02:09.149523 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-498671ba-2053-4695-bbb4-32f4c39c0187 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:09.150279 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-498671ba-2053-4695-bbb4-32f4c39c0187 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 2ecad1bf-3c89-4b29-a511-6e3d71a834fc] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:09.157575 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-498671ba-2053-4695-bbb4-32f4c39c0187 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:09.158073 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-498671ba-2053-4695-bbb4-32f4c39c0187 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:09.158898 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-498671ba-2053-4695-bbb4-32f4c39c0187 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:09.159603 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-498671ba-2053-4695-bbb4-32f4c39c0187 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:09.162861 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:02:09.176725 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.wsgi [None req-498671ba-2053-4695-bbb4-32f4c39c0187 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] HTTP exception thrown: Instance 2ecad1bf-3c89-4b29-a511-6e3d71a834fc could not be found. Jun 03 10:02:09.178492 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-498671ba-2053-4695-bbb4-32f4c39c0187 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Request method failure captured: Jun 03 10:02:09.178492 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: request: GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc HTTP/1.1 Jun 03 10:02:09.178492 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept: application/json Jun 03 10:02:09.178492 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept-Encoding: identity Jun 03 10:02:09.178492 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Connection: close Jun 03 10:02:09.178492 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Length: 0 Jun 03 10:02:09.178492 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Type: application/json Jun 03 10:02:09.178492 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Host: 10.222.0.45 Jun 03 10:02:09.178492 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Openstack-System-Scope: None Jun 03 10:02:09.178492 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: User-Agent: python-urllib3/1.26.9 Jun 03 10:02:09.178492 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Auth-Token: gAAAAABimdrmmGMJYoFEaixKtEm5TQ4XA5jgCy5iwX6ZjbOH9DxrKeyENuD4peBUKmdWr-PDWrDLYLLxy5lixGd2HlPi4aZlZBg9FmZSE7U7_CN_FIxjIovt53hs7DTTUFYYhZcU3_b0MiLpd7TSlEfGmsHpIrMSk9dkjlfpCuRH8mQ4nPiTBOs Jun 03 10:02:09.178492 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Id: None Jun 03 10:02:09.178492 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Name: None Jun 03 10:02:09.178492 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Identity-Status: Confirmed Jun 03 10:02:09.178492 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Is-Admin-Project: True Jun 03 10:02:09.178492 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Id: default Jun 03 10:02:09.178492 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Name: Default Jun 03 10:02:09.178492 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Id: 12d4ca628b894615bc311c3705c4a801 Jun 03 10:02:09.178492 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Name: tempest-AttachVolumeNegativeTest-1776358070 Jun 03 10:02:09.178492 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Role: member,reader Jun 03 10:02:09.178492 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Roles: member,reader Jun 03 10:02:09.179897 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_12d4ca628b894615bc311c3705c4a801", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/12d4ca628b894615bc311c3705c4a801"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/12d4ca628b894615bc311c3705c4a801"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/12d4ca628b894615bc311c3705c4a801"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 10:02:09.179897 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant: tempest-AttachVolumeNegativeTest-1776358070 Jun 03 10:02:09.179897 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Id: 12d4ca628b894615bc311c3705c4a801 Jun 03 10:02:09.179897 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1776358070 Jun 03 10:02:09.179897 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User: tempest-AttachVolumeNegativeTest-1776358070-project Jun 03 10:02:09.179897 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Id: default Jun 03 10:02:09.179897 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Name: Default Jun 03 10:02:09.179897 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Id: e62d9d781281497e9927c0eb0e85dd75 Jun 03 10:02:09.179897 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Name: tempest-AttachVolumeNegativeTest-1776358070-project Jun 03 10:02:09.179897 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: method: > Jun 03 10:02:09.179897 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: exception: Instance 2ecad1bf-3c89-4b29-a511-6e3d71a834fc could not be found. Jun 03 10:02:09.179897 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: action_args: {'id': '2ecad1bf-3c89-4b29-a511-6e3d71a834fc'} Jun 03 10:02:09.180871 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:02:09.180871 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:02:09.180871 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:02:09.180871 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:02:09.180871 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:02:09.180871 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:02:09.180871 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:02:09.180871 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:02:09.180871 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:02:09.180871 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:02:09.180871 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ecad1bf-3c89-4b29-a511-6e3d71a834fc could not be found. Jun 03 10:02:09.180871 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:02:09.180871 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:02:09.180871 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:02:09.180871 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:02:09.180871 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:02:09.180871 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:02:09.180871 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:02:09.180871 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:02:09.180871 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:02:09.182527 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:02:09.182527 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:02:09.182527 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:02:09.182527 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:02:09.182527 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:02:09.182527 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:02:09.182527 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:02:09.182527 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ecad1bf-3c89-4b29-a511-6e3d71a834fc could not be found. Jun 03 10:02:09.182527 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:02:09.182527 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:02:09.182527 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:02:09.182527 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:02:09.182527 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:02:09.182527 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:02:09.182527 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:02:09.182527 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:02:09.182527 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ecad1bf-3c89-4b29-a511-6e3d71a834fc could not be found. Jun 03 10:02:09.182527 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:02:09.183861 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-498671ba-2053-4695-bbb4-32f4c39c0187 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Returning 404 to user: Instance 2ecad1bf-3c89-4b29-a511-6e3d71a834fc could not be found. {{(pid=117648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:02:09.183861 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-498671ba-2053-4695-bbb4-32f4c39c0187 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc" status: 404 len: 111 microversion: 2.1 time: 0.035640 Jun 03 10:02:09.183861 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 315/666] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:09 2022] GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 10:02:09.189541 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-54b3246c-b87e-4d19-81ae-aec563e4b688 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '.version_select at 0x7f5036b6f940>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:09.196074 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:02:09.212045 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-54b3246c-b87e-4d19-81ae-aec563e4b688 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-196741083" status: 202 len: 0 microversion: 2.1 time: 0.027103 Jun 03 10:02:09.212617 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 352/667] 10.222.0.45 () {58 vars in 1217 bytes} [Fri Jun 3 10:02:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-196741083 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 10:02:09.871700 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-263b1c38-419b-47a1-ac2f-df535badef54 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:09.872201 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-263b1c38-419b-47a1-ac2f-df535badef54 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:09.878677 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-263b1c38-419b-47a1-ac2f-df535badef54 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:09.879130 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-263b1c38-419b-47a1-ac2f-df535badef54 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:09.879922 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-263b1c38-419b-47a1-ac2f-df535badef54 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:09.880366 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-263b1c38-419b-47a1-ac2f-df535badef54 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:10.020218 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.objects.instance [None req-263b1c38-419b-47a1-ac2f-df535badef54 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lazy-loading 'services' on Instance uuid 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e {{(pid=117648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:02:10.132409 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-263b1c38-419b-47a1-ac2f-df535badef54 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "DELETE /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e/os-volume_attachments/f8047f5e-515b-42fd-bd16-343ccd47c9e6" status: 202 len: 0 microversion: 2.1 time: 0.264832 Jun 03 10:02:10.133019 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 316/668] 10.222.0.45 () {58 vars in 1415 bytes} [Fri Jun 3 10:02:09 2022] DELETE /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e/os-volume_attachments/f8047f5e-515b-42fd-bd16-343ccd47c9e6 => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 10:02:10.142324 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-88a273cc-3cad-49dc-a59d-61f4d8115252 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:10.143320 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-88a273cc-3cad-49dc-a59d-61f4d8115252 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:10.152658 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-88a273cc-3cad-49dc-a59d-61f4d8115252 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:10.153206 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-88a273cc-3cad-49dc-a59d-61f4d8115252 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:10.154086 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-88a273cc-3cad-49dc-a59d-61f4d8115252 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:10.155238 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-88a273cc-3cad-49dc-a59d-61f4d8115252 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:10.184787 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-88a273cc-3cad-49dc-a59d-61f4d8115252 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047052 Jun 03 10:02:10.189228 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 353/669] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 3 10:02:10 2022] GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:02:11.198044 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-87ea6ed8-1c5b-466f-970d-662a233cbb15 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:11.199114 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-87ea6ed8-1c5b-466f-970d-662a233cbb15 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:11.205920 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-87ea6ed8-1c5b-466f-970d-662a233cbb15 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:11.206379 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-87ea6ed8-1c5b-466f-970d-662a233cbb15 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:11.207269 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-87ea6ed8-1c5b-466f-970d-662a233cbb15 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:11.207711 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-87ea6ed8-1c5b-466f-970d-662a233cbb15 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:11.240994 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-87ea6ed8-1c5b-466f-970d-662a233cbb15 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047831 Jun 03 10:02:11.241539 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 317/670] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 3 10:02:11 2022] GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:02:12.253757 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-860da227-dcb4-4563-b926-a93e28984892 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:12.254862 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-860da227-dcb4-4563-b926-a93e28984892 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:12.262033 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-860da227-dcb4-4563-b926-a93e28984892 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:12.262476 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-860da227-dcb4-4563-b926-a93e28984892 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:12.263232 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-860da227-dcb4-4563-b926-a93e28984892 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:12.263660 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-860da227-dcb4-4563-b926-a93e28984892 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:12.291746 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-860da227-dcb4-4563-b926-a93e28984892 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043403 Jun 03 10:02:12.292275 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 354/671] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 3 10:02:12 2022] GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 10:02:12.348589 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-509c597c-ed79-4ade-b040-39899ad5e357 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:12.349072 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-509c597c-ed79-4ade-b040-39899ad5e357 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:12.355596 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-509c597c-ed79-4ade-b040-39899ad5e357 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:12.356049 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-509c597c-ed79-4ade-b040-39899ad5e357 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:12.356851 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-509c597c-ed79-4ade-b040-39899ad5e357 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:12.357292 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-509c597c-ed79-4ade-b040-39899ad5e357 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:12.381996 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-509c597c-ed79-4ade-b040-39899ad5e357 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e] Going to try to terminate instance {{(pid=117648) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 10:02:12.462509 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-509c597c-ed79-4ade-b040-39899ad5e357 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "DELETE /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e" status: 204 len: 0 microversion: 2.1 time: 0.117334 Jun 03 10:02:12.463189 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 318/672] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jun 3 10:02:12 2022] DELETE /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 10:02:12.473217 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-fbaf5845-8c06-40e5-8610-aba5e6f5aa27 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:12.474290 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-fbaf5845-8c06-40e5-8610-aba5e6f5aa27 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:12.480246 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-fbaf5845-8c06-40e5-8610-aba5e6f5aa27 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:12.480696 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-fbaf5845-8c06-40e5-8610-aba5e6f5aa27 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:12.481467 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-fbaf5845-8c06-40e5-8610-aba5e6f5aa27 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:12.481938 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-fbaf5845-8c06-40e5-8610-aba5e6f5aa27 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:12.610889 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-fbaf5845-8c06-40e5-8610-aba5e6f5aa27 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:12.618840 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-fbaf5845-8c06-40e5-8610-aba5e6f5aa27 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e" status: 200 len: 1681 microversion: 2.1 time: 0.151054 Jun 03 10:02:12.619400 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 355/673] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:12 2022] GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:13.636996 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-fa0409a8-bde6-42ec-ae30-271eb5faede4 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:13.637689 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-fa0409a8-bde6-42ec-ae30-271eb5faede4 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:13.644053 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fa0409a8-bde6-42ec-ae30-271eb5faede4 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:13.644447 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fa0409a8-bde6-42ec-ae30-271eb5faede4 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:13.645208 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fa0409a8-bde6-42ec-ae30-271eb5faede4 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:13.645635 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fa0409a8-bde6-42ec-ae30-271eb5faede4 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:13.770963 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-fa0409a8-bde6-42ec-ae30-271eb5faede4 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:13.778276 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-fa0409a8-bde6-42ec-ae30-271eb5faede4 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e" status: 200 len: 1681 microversion: 2.1 time: 0.145670 Jun 03 10:02:13.778862 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 319/674] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:13 2022] GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e => generated 1681 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:14.795778 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-9679a2e0-a5b7-44f2-8ca1-c479905ba677 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:14.796391 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-9679a2e0-a5b7-44f2-8ca1-c479905ba677 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:14.803060 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9679a2e0-a5b7-44f2-8ca1-c479905ba677 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:14.803510 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9679a2e0-a5b7-44f2-8ca1-c479905ba677 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:14.804552 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9679a2e0-a5b7-44f2-8ca1-c479905ba677 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:14.804990 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9679a2e0-a5b7-44f2-8ca1-c479905ba677 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:14.942545 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-9679a2e0-a5b7-44f2-8ca1-c479905ba677 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:14.949941 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-9679a2e0-a5b7-44f2-8ca1-c479905ba677 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e" status: 200 len: 1681 microversion: 2.1 time: 0.157967 Jun 03 10:02:14.950504 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 356/675] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:14 2022] GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:15.967317 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-2b6401e0-b1d7-4348-9182-a6acf5cedb0b tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:15.968083 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-2b6401e0-b1d7-4348-9182-a6acf5cedb0b tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:15.970623 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:02:15.976059 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2b6401e0-b1d7-4348-9182-a6acf5cedb0b tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:15.976501 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2b6401e0-b1d7-4348-9182-a6acf5cedb0b tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:15.977256 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2b6401e0-b1d7-4348-9182-a6acf5cedb0b tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:15.977740 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2b6401e0-b1d7-4348-9182-a6acf5cedb0b tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:16.050810 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-2b6401e0-b1d7-4348-9182-a6acf5cedb0b tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:16.054697 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-d6caba19-7e5f-4947-82ca-be2b9b0d2df8 req-27136a9c-86c9-470b-bdb8-b7a11a3b7a85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e", "name": "network-vif-deleted", "tag": "9ce3fd34-d579-4eda-8b0a-3d97ea2da07d"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:02:16.059087 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-2b6401e0-b1d7-4348-9182-a6acf5cedb0b tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e" status: 200 len: 1615 microversion: 2.1 time: 0.095528 Jun 03 10:02:16.060315 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 320/676] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:15 2022] GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e => generated 1615 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:16.066084 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-d6caba19-7e5f-4947-82ca-be2b9b0d2df8 req-27136a9c-86c9-470b-bdb8-b7a11a3b7a85 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:16.066527 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-d6caba19-7e5f-4947-82ca-be2b9b0d2df8 req-27136a9c-86c9-470b-bdb8-b7a11a3b7a85 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:16.078769 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-d6caba19-7e5f-4947-82ca-be2b9b0d2df8 req-27136a9c-86c9-470b-bdb8-b7a11a3b7a85 service nova] Creating event network-vif-deleted:9ce3fd34-d579-4eda-8b0a-3d97ea2da07d for instance 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e on hv-cinder-79760 Jun 03 10:02:16.083650 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-d6caba19-7e5f-4947-82ca-be2b9b0d2df8 req-27136a9c-86c9-470b-bdb8-b7a11a3b7a85 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032530 Jun 03 10:02:16.084226 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 357/677] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 10:02:17.076829 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-e5ec079c-87a0-4c4c-a7ea-e642abfea656 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:17.077445 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-e5ec079c-87a0-4c4c-a7ea-e642abfea656 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:17.083953 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e5ec079c-87a0-4c4c-a7ea-e642abfea656 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:17.084400 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e5ec079c-87a0-4c4c-a7ea-e642abfea656 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:17.085160 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e5ec079c-87a0-4c4c-a7ea-e642abfea656 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:17.085594 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e5ec079c-87a0-4c4c-a7ea-e642abfea656 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:17.098739 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.wsgi [None req-e5ec079c-87a0-4c4c-a7ea-e642abfea656 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] HTTP exception thrown: Instance 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e could not be found. Jun 03 10:02:17.100349 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-e5ec079c-87a0-4c4c-a7ea-e642abfea656 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Request method failure captured: Jun 03 10:02:17.100349 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: request: GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e HTTP/1.1 Jun 03 10:02:17.100349 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept: application/json Jun 03 10:02:17.100349 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept-Encoding: identity Jun 03 10:02:17.100349 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Connection: close Jun 03 10:02:17.100349 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Length: 0 Jun 03 10:02:17.100349 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Type: application/json Jun 03 10:02:17.100349 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Host: 10.222.0.45 Jun 03 10:02:17.100349 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Openstack-System-Scope: None Jun 03 10:02:17.100349 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: User-Agent: python-urllib3/1.26.9 Jun 03 10:02:17.100349 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Auth-Token: gAAAAABimdrmmGMJYoFEaixKtEm5TQ4XA5jgCy5iwX6ZjbOH9DxrKeyENuD4peBUKmdWr-PDWrDLYLLxy5lixGd2HlPi4aZlZBg9FmZSE7U7_CN_FIxjIovt53hs7DTTUFYYhZcU3_b0MiLpd7TSlEfGmsHpIrMSk9dkjlfpCuRH8mQ4nPiTBOs Jun 03 10:02:17.100349 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Id: None Jun 03 10:02:17.100349 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Name: None Jun 03 10:02:17.100349 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Identity-Status: Confirmed Jun 03 10:02:17.100349 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Is-Admin-Project: True Jun 03 10:02:17.100349 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Id: default Jun 03 10:02:17.100349 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Name: Default Jun 03 10:02:17.100349 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Id: 12d4ca628b894615bc311c3705c4a801 Jun 03 10:02:17.100349 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Name: tempest-AttachVolumeNegativeTest-1776358070 Jun 03 10:02:17.100349 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Role: member,reader Jun 03 10:02:17.100349 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Roles: member,reader Jun 03 10:02:17.101947 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_12d4ca628b894615bc311c3705c4a801", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/12d4ca628b894615bc311c3705c4a801"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/12d4ca628b894615bc311c3705c4a801"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/12d4ca628b894615bc311c3705c4a801"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 10:02:17.101947 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant: tempest-AttachVolumeNegativeTest-1776358070 Jun 03 10:02:17.101947 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Id: 12d4ca628b894615bc311c3705c4a801 Jun 03 10:02:17.101947 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1776358070 Jun 03 10:02:17.101947 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User: tempest-AttachVolumeNegativeTest-1776358070-project Jun 03 10:02:17.101947 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Id: default Jun 03 10:02:17.101947 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Name: Default Jun 03 10:02:17.101947 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Id: e62d9d781281497e9927c0eb0e85dd75 Jun 03 10:02:17.101947 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Name: tempest-AttachVolumeNegativeTest-1776358070-project Jun 03 10:02:17.101947 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: method: > Jun 03 10:02:17.101947 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: exception: Instance 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e could not be found. Jun 03 10:02:17.101947 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: action_args: {'id': '6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e'} Jun 03 10:02:17.102759 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:02:17.102759 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:02:17.102759 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:02:17.102759 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:02:17.102759 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:02:17.102759 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:02:17.102759 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:02:17.102759 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:02:17.102759 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:02:17.102759 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:02:17.102759 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e could not be found. Jun 03 10:02:17.102759 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:02:17.102759 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:02:17.102759 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:02:17.102759 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:02:17.102759 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:02:17.102759 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:02:17.102759 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:02:17.102759 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:02:17.102759 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:02:17.104087 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:02:17.104087 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:02:17.104087 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:02:17.104087 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:02:17.104087 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:02:17.104087 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:02:17.104087 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:02:17.104087 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e could not be found. Jun 03 10:02:17.104087 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:02:17.104087 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:02:17.104087 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:02:17.104087 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:02:17.104087 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:02:17.104087 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:02:17.104087 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:02:17.104087 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:02:17.104087 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e could not be found. Jun 03 10:02:17.104087 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:02:17.105378 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-e5ec079c-87a0-4c4c-a7ea-e642abfea656 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Returning 404 to user: Instance 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e could not be found. {{(pid=117648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:02:17.105378 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-e5ec079c-87a0-4c4c-a7ea-e642abfea656 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e" status: 404 len: 111 microversion: 2.1 time: 0.028805 Jun 03 10:02:17.105378 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 321/678] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:17 2022] GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 10:02:17.112210 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-43519d27-bd40-45ee-8b85-a17c9ef7db15 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '.version_select at 0x7f5036ad3280>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:17.129198 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-43519d27-bd40-45ee-8b85-a17c9ef7db15 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1986502259" status: 202 len: 0 microversion: 2.1 time: 0.022245 Jun 03 10:02:17.129766 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 358/679] 10.222.0.45 () {58 vars in 1220 bytes} [Fri Jun 3 10:02:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1986502259 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 10:02:17.730014 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-65408d42-7aff-47f9-b1ef-c45723808509 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Action: 'create', calling method: .version_select at 0x7f5036aec310>, body: {"keypair": {"name": "tempest-keypair-1586986021", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjVYRfIxjHHi5SGBsaleXTW4d8CzMu5XxcCTnfhqJJ1xKtOg5MsPp3yXcqXtxvnA+a2jvDEaYfsxYNB4vAVEx4PAr4gEVhrRM6yXn274Akxb1QPbpD36V81ppaLOCqyMw=="}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:02:17.743977 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-65408d42-7aff-47f9-b1ef-c45723808509 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Getting quotas for project 12d4ca628b894615bc311c3705c4a801. Resources: {'key_pairs'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 10:02:17.747775 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-65408d42-7aff-47f9-b1ef-c45723808509 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Getting quotas for user e62d9d781281497e9927c0eb0e85dd75 and project 12d4ca628b894615bc311c3705c4a801. Resources: {'key_pairs'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 10:02:17.768927 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-65408d42-7aff-47f9-b1ef-c45723808509 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.042876 Jun 03 10:02:17.769493 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 322/680] 10.222.0.45 () {60 vars in 1158 bytes} [Fri Jun 3 10:02:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:02:18.916154 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-9d10a798-0fa2-4682-b61d-57147bd372c1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1885767824", "imageRef": "0cb3b007-4e95-448b-8acb-895d8acdb244", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3baa3021-e41d-411e-bddb-b3793d770962"}], "security_groups": [{"name": "tempest-securitygroup--546502687"}], "key_name": "tempest-keypair-1586986021", "user_data": "}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:02:19.015528 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.network.neutron [None req-9d10a798-0fa2-4682-b61d-57147bd372c1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] validate_networks() for [('3baa3021-e41d-411e-bddb-b3793d770962', None, None, None, None, None)] {{(pid=117647) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 10:02:19.412988 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-9d10a798-0fa2-4682-b61d-57147bd372c1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Flavor limits 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 10:02:19.413409 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-9d10a798-0fa2-4682-b61d-57147bd372c1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Image limits 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 10:02:19.413915 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-9d10a798-0fa2-4682-b61d-57147bd372c1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Flavor pref 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 10:02:19.414347 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-9d10a798-0fa2-4682-b61d-57147bd372c1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Image pref 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 10:02:19.414782 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-9d10a798-0fa2-4682-b61d-57147bd372c1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 10:02:19.423522 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9d10a798-0fa2-4682-b61d-57147bd372c1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:19.423962 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9d10a798-0fa2-4682-b61d-57147bd372c1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:19.424747 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9d10a798-0fa2-4682-b61d-57147bd372c1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:19.425183 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9d10a798-0fa2-4682-b61d-57147bd372c1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:19.441913 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-9d10a798-0fa2-4682-b61d-57147bd372c1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Getting quotas for project 12d4ca628b894615bc311c3705c4a801. Resources: {'ram', 'cores', 'instances'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 10:02:19.445804 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-9d10a798-0fa2-4682-b61d-57147bd372c1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Getting quotas for user e62d9d781281497e9927c0eb0e85dd75 and project 12d4ca628b894615bc311c3705c4a801. Resources: {'ram', 'cores', 'instances'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 10:02:19.457136 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-9d10a798-0fa2-4682-b61d-57147bd372c1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Going to run 1 instances... {{(pid=117647) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 10:02:19.459459 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-9d10a798-0fa2-4682-b61d-57147bd372c1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: b85ca18b-9b76-43c9-af4d-d7bf77231976] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0cb3b007-4e95-448b-8acb-895d8acdb244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 10:02:19.505519 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-9d10a798-0fa2-4682-b61d-57147bd372c1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.594122 Jun 03 10:02:19.506197 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 359/681] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jun 3 10:02:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 10:02:19.517267 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-c5bcc7ce-f5b8-4b1b-ace7-d425e5ff9336 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:19.517911 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-c5bcc7ce-f5b8-4b1b-ace7-d425e5ff9336 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: b85ca18b-9b76-43c9-af4d-d7bf77231976] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:19.573522 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-c5bcc7ce-f5b8-4b1b-ace7-d425e5ff9336 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:19.581176 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-c5bcc7ce-f5b8-4b1b-ace7-d425e5ff9336 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/b85ca18b-9b76-43c9-af4d-d7bf77231976" status: 200 len: 1242 microversion: 2.1 time: 0.068804 Jun 03 10:02:19.581814 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 323/682] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:19 2022] GET /compute/v2.1/servers/b85ca18b-9b76-43c9-af4d-d7bf77231976 => generated 1242 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:20.598010 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-657cb41e-d02c-44de-91b7-eabc4e63f280 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:20.598621 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-657cb41e-d02c-44de-91b7-eabc4e63f280 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: b85ca18b-9b76-43c9-af4d-d7bf77231976] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:20.604950 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-657cb41e-d02c-44de-91b7-eabc4e63f280 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:20.605387 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-657cb41e-d02c-44de-91b7-eabc4e63f280 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:20.606168 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-657cb41e-d02c-44de-91b7-eabc4e63f280 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:20.606600 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-657cb41e-d02c-44de-91b7-eabc4e63f280 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:20.670482 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-657cb41e-d02c-44de-91b7-eabc4e63f280 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:20.678342 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-657cb41e-d02c-44de-91b7-eabc4e63f280 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/b85ca18b-9b76-43c9-af4d-d7bf77231976" status: 200 len: 1294 microversion: 2.1 time: 0.084719 Jun 03 10:02:20.678891 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 360/683] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:20 2022] GET /compute/v2.1/servers/b85ca18b-9b76-43c9-af4d-d7bf77231976 => generated 1294 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:21.695424 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-892a5135-ffcd-4afe-8605-06d223eb4fa3 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:21.696030 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-892a5135-ffcd-4afe-8605-06d223eb4fa3 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: b85ca18b-9b76-43c9-af4d-d7bf77231976] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:21.703722 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-892a5135-ffcd-4afe-8605-06d223eb4fa3 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:21.704181 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-892a5135-ffcd-4afe-8605-06d223eb4fa3 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:21.704948 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-892a5135-ffcd-4afe-8605-06d223eb4fa3 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:21.705400 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-892a5135-ffcd-4afe-8605-06d223eb4fa3 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:21.770758 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-892a5135-ffcd-4afe-8605-06d223eb4fa3 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:21.782213 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-892a5135-ffcd-4afe-8605-06d223eb4fa3 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/b85ca18b-9b76-43c9-af4d-d7bf77231976" status: 200 len: 1300 microversion: 2.1 time: 0.090526 Jun 03 10:02:21.782785 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 324/684] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:21 2022] GET /compute/v2.1/servers/b85ca18b-9b76-43c9-af4d-d7bf77231976 => generated 1300 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:22.800804 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-f5fa0be9-14e3-406d-8759-d9424ca5deb6 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:22.801608 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-f5fa0be9-14e3-406d-8759-d9424ca5deb6 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: b85ca18b-9b76-43c9-af4d-d7bf77231976] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:22.808482 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f5fa0be9-14e3-406d-8759-d9424ca5deb6 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:22.809024 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f5fa0be9-14e3-406d-8759-d9424ca5deb6 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:22.809969 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f5fa0be9-14e3-406d-8759-d9424ca5deb6 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:22.810645 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f5fa0be9-14e3-406d-8759-d9424ca5deb6 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:22.953054 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-a3f7cb9c-8d2c-43d1-8530-afd032063d8f req-2f6848ba-c134-4c4d-85ed-e2e665fc88da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b85ca18b-9b76-43c9-af4d-d7bf77231976", "tag": "5cb4beca-4bc2-4d76-9c45-84156f1ae5fb"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:02:22.958714 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-f5fa0be9-14e3-406d-8759-d9424ca5deb6 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:22.969767 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-f5fa0be9-14e3-406d-8759-d9424ca5deb6 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/b85ca18b-9b76-43c9-af4d-d7bf77231976" status: 200 len: 1367 microversion: 2.1 time: 0.173801 Jun 03 10:02:22.971302 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 361/685] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:22 2022] GET /compute/v2.1/servers/b85ca18b-9b76-43c9-af4d-d7bf77231976 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:22.974786 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-a3f7cb9c-8d2c-43d1-8530-afd032063d8f req-2f6848ba-c134-4c4d-85ed-e2e665fc88da service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:22.975248 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-a3f7cb9c-8d2c-43d1-8530-afd032063d8f req-2f6848ba-c134-4c4d-85ed-e2e665fc88da service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:22.989665 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-a3f7cb9c-8d2c-43d1-8530-afd032063d8f req-2f6848ba-c134-4c4d-85ed-e2e665fc88da service nova] Creating event network-changed:5cb4beca-4bc2-4d76-9c45-84156f1ae5fb for instance b85ca18b-9b76-43c9-af4d-d7bf77231976 on hv-cinder-79760 Jun 03 10:02:22.994881 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-a3f7cb9c-8d2c-43d1-8530-afd032063d8f req-2f6848ba-c134-4c4d-85ed-e2e665fc88da service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045441 Jun 03 10:02:22.995777 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 325/686] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:02:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 10:02:23.987738 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-71815a40-702a-4bf3-bdd1-5ac4f474522f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:23.988351 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-71815a40-702a-4bf3-bdd1-5ac4f474522f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: b85ca18b-9b76-43c9-af4d-d7bf77231976] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:23.994900 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-71815a40-702a-4bf3-bdd1-5ac4f474522f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:23.995352 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-71815a40-702a-4bf3-bdd1-5ac4f474522f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:23.996118 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-71815a40-702a-4bf3-bdd1-5ac4f474522f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:23.996558 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-71815a40-702a-4bf3-bdd1-5ac4f474522f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:24.132734 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-71815a40-702a-4bf3-bdd1-5ac4f474522f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:24.145780 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-71815a40-702a-4bf3-bdd1-5ac4f474522f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/b85ca18b-9b76-43c9-af4d-d7bf77231976" status: 200 len: 1367 microversion: 2.1 time: 0.161827 Jun 03 10:02:24.146395 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 362/687] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:23 2022] GET /compute/v2.1/servers/b85ca18b-9b76-43c9-af4d-d7bf77231976 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:25.164318 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-0cc5d2cc-0b19-4661-b7d9-f5c8d97f2a31 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:25.165008 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-0cc5d2cc-0b19-4661-b7d9-f5c8d97f2a31 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: b85ca18b-9b76-43c9-af4d-d7bf77231976] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:25.171193 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0cc5d2cc-0b19-4661-b7d9-f5c8d97f2a31 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:25.171632 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0cc5d2cc-0b19-4661-b7d9-f5c8d97f2a31 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:25.172381 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0cc5d2cc-0b19-4661-b7d9-f5c8d97f2a31 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:25.172810 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0cc5d2cc-0b19-4661-b7d9-f5c8d97f2a31 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:25.302066 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-0cc5d2cc-0b19-4661-b7d9-f5c8d97f2a31 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:25.309323 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-0cc5d2cc-0b19-4661-b7d9-f5c8d97f2a31 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/b85ca18b-9b76-43c9-af4d-d7bf77231976" status: 200 len: 1367 microversion: 2.1 time: 0.149844 Jun 03 10:02:25.309921 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 326/688] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:25 2022] GET /compute/v2.1/servers/b85ca18b-9b76-43c9-af4d-d7bf77231976 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:26.325884 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-11356d5b-95e2-4b18-8518-7af5c4cf1c16 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:26.326505 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-11356d5b-95e2-4b18-8518-7af5c4cf1c16 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: b85ca18b-9b76-43c9-af4d-d7bf77231976] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:26.334681 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-11356d5b-95e2-4b18-8518-7af5c4cf1c16 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:26.335129 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-11356d5b-95e2-4b18-8518-7af5c4cf1c16 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:26.335895 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-11356d5b-95e2-4b18-8518-7af5c4cf1c16 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:26.336332 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-11356d5b-95e2-4b18-8518-7af5c4cf1c16 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:26.466560 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-11356d5b-95e2-4b18-8518-7af5c4cf1c16 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:26.474664 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-11356d5b-95e2-4b18-8518-7af5c4cf1c16 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/b85ca18b-9b76-43c9-af4d-d7bf77231976" status: 200 len: 1367 microversion: 2.1 time: 0.152620 Jun 03 10:02:26.475234 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 363/689] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:26 2022] GET /compute/v2.1/servers/b85ca18b-9b76-43c9-af4d-d7bf77231976 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:27.491298 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-4f214c52-9daf-40fd-8d11-ce6a7b35c68d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:27.491912 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-4f214c52-9daf-40fd-8d11-ce6a7b35c68d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: b85ca18b-9b76-43c9-af4d-d7bf77231976] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:27.498438 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4f214c52-9daf-40fd-8d11-ce6a7b35c68d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:27.498884 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4f214c52-9daf-40fd-8d11-ce6a7b35c68d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:27.499643 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4f214c52-9daf-40fd-8d11-ce6a7b35c68d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:27.500633 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4f214c52-9daf-40fd-8d11-ce6a7b35c68d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:27.628933 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-4f214c52-9daf-40fd-8d11-ce6a7b35c68d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:27.636215 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-4f214c52-9daf-40fd-8d11-ce6a7b35c68d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/b85ca18b-9b76-43c9-af4d-d7bf77231976" status: 200 len: 1367 microversion: 2.1 time: 0.148785 Jun 03 10:02:27.636772 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 327/690] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:27 2022] GET /compute/v2.1/servers/b85ca18b-9b76-43c9-af4d-d7bf77231976 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:28.652549 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-a5f2d192-ace5-48fb-aac6-f0bb11c6cdc9 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:28.653079 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-a5f2d192-ace5-48fb-aac6-f0bb11c6cdc9 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: b85ca18b-9b76-43c9-af4d-d7bf77231976] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:28.660419 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a5f2d192-ace5-48fb-aac6-f0bb11c6cdc9 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:28.660878 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a5f2d192-ace5-48fb-aac6-f0bb11c6cdc9 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:28.661645 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a5f2d192-ace5-48fb-aac6-f0bb11c6cdc9 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:28.662115 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a5f2d192-ace5-48fb-aac6-f0bb11c6cdc9 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:28.790864 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-a5f2d192-ace5-48fb-aac6-f0bb11c6cdc9 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:28.798375 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-a5f2d192-ace5-48fb-aac6-f0bb11c6cdc9 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/b85ca18b-9b76-43c9-af4d-d7bf77231976" status: 200 len: 1367 microversion: 2.1 time: 0.149793 Jun 03 10:02:28.798939 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 364/691] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:28 2022] GET /compute/v2.1/servers/b85ca18b-9b76-43c9-af4d-d7bf77231976 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:28.912971 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-d6042fe9-21cb-47d1-9423-27af4ac68460 req-ad16a95f-6ee5-4d9c-828e-5999e3e5b848 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b85ca18b-9b76-43c9-af4d-d7bf77231976", "name": "network-vif-plugged", "status": "completed", "tag": "5cb4beca-4bc2-4d76-9c45-84156f1ae5fb"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:02:28.921158 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-d6042fe9-21cb-47d1-9423-27af4ac68460 req-ad16a95f-6ee5-4d9c-828e-5999e3e5b848 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:28.921636 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-d6042fe9-21cb-47d1-9423-27af4ac68460 req-ad16a95f-6ee5-4d9c-828e-5999e3e5b848 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:28.932312 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-d6042fe9-21cb-47d1-9423-27af4ac68460 req-ad16a95f-6ee5-4d9c-828e-5999e3e5b848 service nova] Creating event network-vif-plugged:5cb4beca-4bc2-4d76-9c45-84156f1ae5fb for instance b85ca18b-9b76-43c9-af4d-d7bf77231976 on hv-cinder-79760 Jun 03 10:02:28.936936 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-d6042fe9-21cb-47d1-9423-27af4ac68460 req-ad16a95f-6ee5-4d9c-828e-5999e3e5b848 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083449 Jun 03 10:02:28.937507 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 328/692] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:02:29.815525 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-e2c258c0-61de-46d6-bee4-004cb2b011fd tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:29.816642 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-e2c258c0-61de-46d6-bee4-004cb2b011fd tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: b85ca18b-9b76-43c9-af4d-d7bf77231976] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:29.820094 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell0:SELECT=2 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:02:29.820769 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell0:SELECT=6 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:02:29.826159 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e2c258c0-61de-46d6-bee4-004cb2b011fd tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:29.826611 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e2c258c0-61de-46d6-bee4-004cb2b011fd tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:29.827379 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e2c258c0-61de-46d6-bee4-004cb2b011fd tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:29.828416 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e2c258c0-61de-46d6-bee4-004cb2b011fd tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:29.959680 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-e2c258c0-61de-46d6-bee4-004cb2b011fd tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:29.966996 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-e2c258c0-61de-46d6-bee4-004cb2b011fd tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/b85ca18b-9b76-43c9-af4d-d7bf77231976" status: 200 len: 1367 microversion: 2.1 time: 0.156049 Jun 03 10:02:29.967552 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 365/693] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:29 2022] GET /compute/v2.1/servers/b85ca18b-9b76-43c9-af4d-d7bf77231976 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:30.980813 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell0:SELECT=6 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:02:30.986097 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-5d5ecf48-c930-4c83-b44a-7c1ceb6b5b13 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:30.986823 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-5d5ecf48-c930-4c83-b44a-7c1ceb6b5b13 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: b85ca18b-9b76-43c9-af4d-d7bf77231976] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:30.993477 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5d5ecf48-c930-4c83-b44a-7c1ceb6b5b13 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:30.993957 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5d5ecf48-c930-4c83-b44a-7c1ceb6b5b13 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:30.994723 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5d5ecf48-c930-4c83-b44a-7c1ceb6b5b13 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:30.995157 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5d5ecf48-c930-4c83-b44a-7c1ceb6b5b13 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:31.124308 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-5d5ecf48-c930-4c83-b44a-7c1ceb6b5b13 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:31.132077 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-5d5ecf48-c930-4c83-b44a-7c1ceb6b5b13 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/b85ca18b-9b76-43c9-af4d-d7bf77231976" status: 200 len: 1367 microversion: 2.1 time: 0.152281 Jun 03 10:02:31.132831 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 329/694] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:30 2022] GET /compute/v2.1/servers/b85ca18b-9b76-43c9-af4d-d7bf77231976 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:32.148832 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-74de6e2d-3775-47e5-b5fe-636f16e66589 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:32.149449 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-74de6e2d-3775-47e5-b5fe-636f16e66589 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: b85ca18b-9b76-43c9-af4d-d7bf77231976] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:32.156202 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-74de6e2d-3775-47e5-b5fe-636f16e66589 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:32.156659 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-74de6e2d-3775-47e5-b5fe-636f16e66589 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:32.157428 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-74de6e2d-3775-47e5-b5fe-636f16e66589 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:32.157895 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-74de6e2d-3775-47e5-b5fe-636f16e66589 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:32.284946 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-74de6e2d-3775-47e5-b5fe-636f16e66589 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:32.292405 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-74de6e2d-3775-47e5-b5fe-636f16e66589 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/b85ca18b-9b76-43c9-af4d-d7bf77231976" status: 200 len: 1557 microversion: 2.1 time: 0.147486 Jun 03 10:02:32.292961 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 366/695] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:32 2022] GET /compute/v2.1/servers/b85ca18b-9b76-43c9-af4d-d7bf77231976 => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:32.308729 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-b1e25c35-b1c8-4484-8999-1481ade2ae56 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:32.309248 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-b1e25c35-b1c8-4484-8999-1481ade2ae56 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: b85ca18b-9b76-43c9-af4d-d7bf77231976] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:32.315762 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b1e25c35-b1c8-4484-8999-1481ade2ae56 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:32.316214 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b1e25c35-b1c8-4484-8999-1481ade2ae56 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:32.316979 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b1e25c35-b1c8-4484-8999-1481ade2ae56 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:32.317424 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b1e25c35-b1c8-4484-8999-1481ade2ae56 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:32.394320 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-b1e25c35-b1c8-4484-8999-1481ade2ae56 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/b85ca18b-9b76-43c9-af4d-d7bf77231976/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089371 Jun 03 10:02:32.394920 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 330/696] 10.222.0.45 () {58 vars in 1274 bytes} [Fri Jun 3 10:02:32 2022] GET /compute/v2.1/servers/b85ca18b-9b76-43c9-af4d-d7bf77231976/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:02:33.541371 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-8e5adc32-5b81-42b1-9355-e5e808fc083b req-42004202-f315-451e-859d-38105e94b6ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b85ca18b-9b76-43c9-af4d-d7bf77231976", "tag": "5cb4beca-4bc2-4d76-9c45-84156f1ae5fb"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:02:33.549853 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-8e5adc32-5b81-42b1-9355-e5e808fc083b req-42004202-f315-451e-859d-38105e94b6ea service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:33.550290 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-8e5adc32-5b81-42b1-9355-e5e808fc083b req-42004202-f315-451e-859d-38105e94b6ea service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:33.560917 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-8e5adc32-5b81-42b1-9355-e5e808fc083b req-42004202-f315-451e-859d-38105e94b6ea service nova] Creating event network-changed:5cb4beca-4bc2-4d76-9c45-84156f1ae5fb for instance b85ca18b-9b76-43c9-af4d-d7bf77231976 on hv-cinder-79760 Jun 03 10:02:33.566441 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-8e5adc32-5b81-42b1-9355-e5e808fc083b req-42004202-f315-451e-859d-38105e94b6ea service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088286 Jun 03 10:02:33.567028 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 367/697] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:02:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:02:42.885377 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:02:42.886152 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell1:SELECT=76,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:02:42.991555 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-ad72a294-7c07-48d4-a168-44550014401a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:42.992096 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-ad72a294-7c07-48d4-a168-44550014401a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:42.998355 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ad72a294-7c07-48d4-a168-44550014401a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:42.998808 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ad72a294-7c07-48d4-a168-44550014401a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:43.000191 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ad72a294-7c07-48d4-a168-44550014401a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:43.000629 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ad72a294-7c07-48d4-a168-44550014401a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:43.028531 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-ad72a294-7c07-48d4-a168-44550014401a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f/os-volume_attachments/8df22a00-8205-4799-9bd0-86e00c4c8678" status: 200 len: 194 microversion: 2.20 time: 0.144630 Jun 03 10:02:43.029090 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 331/698] 10.222.0.45 () {60 vars in 1453 bytes} [Fri Jun 3 10:02:42 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f/os-volume_attachments/8df22a00-8205-4799-9bd0-86e00c4c8678 => generated 194 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 10:02:43.091775 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-262cae67-aed4-44f4-b57b-7fcfac211efc tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:43.092404 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-262cae67-aed4-44f4-b57b-7fcfac211efc tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:43.094850 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_api:SELECT=47,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:02:43.100408 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-262cae67-aed4-44f4-b57b-7fcfac211efc tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:43.100859 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-262cae67-aed4-44f4-b57b-7fcfac211efc tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:43.101630 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-262cae67-aed4-44f4-b57b-7fcfac211efc tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:43.102092 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-262cae67-aed4-44f4-b57b-7fcfac211efc tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:43.105723 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=82 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:02:43.187394 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.objects.instance [None req-262cae67-aed4-44f4-b57b-7fcfac211efc tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lazy-loading 'services' on Instance uuid 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f {{(pid=117647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:02:43.303012 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-262cae67-aed4-44f4-b57b-7fcfac211efc tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "DELETE /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f/os-volume_attachments/8df22a00-8205-4799-9bd0-86e00c4c8678" status: 202 len: 0 microversion: 2.20 time: 0.215943 Jun 03 10:02:43.303649 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 368/699] 10.222.0.45 () {60 vars in 1456 bytes} [Fri Jun 3 10:02:43 2022] DELETE /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f/os-volume_attachments/8df22a00-8205-4799-9bd0-86e00c4c8678 => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 03 10:02:43.313039 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-80d16923-a55f-434c-aadd-e2820160961a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:43.314174 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-80d16923-a55f-434c-aadd-e2820160961a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:43.321660 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-80d16923-a55f-434c-aadd-e2820160961a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:43.322196 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-80d16923-a55f-434c-aadd-e2820160961a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:43.323003 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-80d16923-a55f-434c-aadd-e2820160961a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:43.323582 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-80d16923-a55f-434c-aadd-e2820160961a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:43.360643 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-80d16923-a55f-434c-aadd-e2820160961a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052321 Jun 03 10:02:43.361209 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 332/700] 10.222.0.45 () {60 vars in 1342 bytes} [Fri Jun 3 10:02:43 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 10:02:43.723426 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-2e9a43e3-898e-413e-b07f-6613066844e6 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-994629307"}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:02:43.724087 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-2e9a43e3-898e-413e-b07f-6613066844e6 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:43.730683 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2e9a43e3-898e-413e-b07f-6613066844e6 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:43.731412 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2e9a43e3-898e-413e-b07f-6613066844e6 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:43.732554 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2e9a43e3-898e-413e-b07f-6613066844e6 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:43.733140 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2e9a43e3-898e-413e-b07f-6613066844e6 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:43.868184 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.network.security_group_api [None req-2e9a43e3-898e-413e-b07f-6613066844e6 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Removing security group ebfe230a-212b-464f-bfbf-66217d09301d from port 1567f4c3-0049-47d8-914a-22f5172d29dc Jun 03 10:02:44.267479 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-2e9a43e3-898e-413e-b07f-6613066844e6 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "POST /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f/action" status: 202 len: 0 microversion: 2.1 time: 0.548304 Jun 03 10:02:44.268771 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 369/701] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jun 3 10:02:43 2022] POST /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f/action => generated 0 bytes in 551 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 10:02:44.271564 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-b3471809-86a5-4c15-9499-d08d8717bcd5 req-f83ed96d-0baa-4321-84e8-85892b1d5e2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef716191-e303-4e00-a92c-78d4fb06063f", "tag": "1567f4c3-0049-47d8-914a-22f5172d29dc"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:02:44.280403 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-b3471809-86a5-4c15-9499-d08d8717bcd5 req-f83ed96d-0baa-4321-84e8-85892b1d5e2e service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:44.281241 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-b3471809-86a5-4c15-9499-d08d8717bcd5 req-f83ed96d-0baa-4321-84e8-85892b1d5e2e service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:44.297078 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-b3471809-86a5-4c15-9499-d08d8717bcd5 req-f83ed96d-0baa-4321-84e8-85892b1d5e2e service nova] Creating event network-changed:1567f4c3-0049-47d8-914a-22f5172d29dc for instance ef716191-e303-4e00-a92c-78d4fb06063f on hv-cinder-79760 Jun 03 10:02:44.305019 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-b3471809-86a5-4c15-9499-d08d8717bcd5 req-f83ed96d-0baa-4321-84e8-85892b1d5e2e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037108 Jun 03 10:02:44.308667 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 333/702] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 10:02:44.372789 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-cb8c2c0c-1e17-441b-b58e-412918c56a24 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:44.374137 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-cb8c2c0c-1e17-441b-b58e-412918c56a24 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:44.387165 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cb8c2c0c-1e17-441b-b58e-412918c56a24 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:44.387774 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cb8c2c0c-1e17-441b-b58e-412918c56a24 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:44.388585 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cb8c2c0c-1e17-441b-b58e-412918c56a24 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:44.389021 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cb8c2c0c-1e17-441b-b58e-412918c56a24 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:44.462644 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-cb8c2c0c-1e17-441b-b58e-412918c56a24 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.093992 Jun 03 10:02:44.466573 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 370/703] 10.222.0.45 () {60 vars in 1342 bytes} [Fri Jun 3 10:02:44 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 10:02:45.396596 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-88b3996d-5176-4556-b271-b3e8425b003f tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:45.397211 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-88b3996d-5176-4556-b271-b3e8425b003f tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:45.403697 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-88b3996d-5176-4556-b271-b3e8425b003f tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:45.404153 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-88b3996d-5176-4556-b271-b3e8425b003f tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:45.404932 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-88b3996d-5176-4556-b271-b3e8425b003f tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:45.405372 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-88b3996d-5176-4556-b271-b3e8425b003f tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:45.474950 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-4b7becaf-a03a-424a-9e77-99d972dc0ea8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:45.475883 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-4b7becaf-a03a-424a-9e77-99d972dc0ea8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:45.482617 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4b7becaf-a03a-424a-9e77-99d972dc0ea8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:45.486835 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4b7becaf-a03a-424a-9e77-99d972dc0ea8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:45.487131 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4b7becaf-a03a-424a-9e77-99d972dc0ea8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:45.488724 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4b7becaf-a03a-424a-9e77-99d972dc0ea8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:45.491668 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.objects.instance [None req-88b3996d-5176-4556-b271-b3e8425b003f tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lazy-loading 'services' on Instance uuid ef716191-e303-4e00-a92c-78d4fb06063f {{(pid=117648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:02:45.526162 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-4b7becaf-a03a-424a-9e77-99d972dc0ea8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.055156 Jun 03 10:02:45.526743 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 371/704] 10.222.0.45 () {60 vars in 1342 bytes} [Fri Jun 3 10:02:45 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:02:45.577092 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-88b3996d-5176-4556-b271-b3e8425b003f tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "DELETE /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f/os-volume_attachments/e7fa8335-7b82-43c0-86ea-c6d74fdcdefc" status: 202 len: 0 microversion: 2.1 time: 0.191520 Jun 03 10:02:45.581227 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 334/705] 10.222.0.45 () {58 vars in 1415 bytes} [Fri Jun 3 10:02:45 2022] DELETE /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f/os-volume_attachments/e7fa8335-7b82-43c0-86ea-c6d74fdcdefc => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 10:02:45.588057 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-494e25bb-7366-4132-887e-413ce1ea96df tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:45.589148 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-494e25bb-7366-4132-887e-413ce1ea96df tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:45.594967 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-d53890dc-ae16-4f50-8a94-d0f3fc18071e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:45.595792 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-d53890dc-ae16-4f50-8a94-d0f3fc18071e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:45.595985 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-494e25bb-7366-4132-887e-413ce1ea96df tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:45.596442 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-494e25bb-7366-4132-887e-413ce1ea96df tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:45.597220 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-494e25bb-7366-4132-887e-413ce1ea96df tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:45.597711 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-494e25bb-7366-4132-887e-413ce1ea96df tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:45.602301 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d53890dc-ae16-4f50-8a94-d0f3fc18071e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:45.603016 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d53890dc-ae16-4f50-8a94-d0f3fc18071e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:45.604019 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d53890dc-ae16-4f50-8a94-d0f3fc18071e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:45.604462 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d53890dc-ae16-4f50-8a94-d0f3fc18071e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:45.629304 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-494e25bb-7366-4132-887e-413ce1ea96df tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046239 Jun 03 10:02:45.630316 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 372/706] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 3 10:02:45 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:02:45.630468 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-d53890dc-ae16-4f50-8a94-d0f3fc18071e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Going to try to terminate instance {{(pid=117648) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 10:02:45.714441 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-d53890dc-ae16-4f50-8a94-d0f3fc18071e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "DELETE /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 204 len: 0 microversion: 2.20 time: 0.123756 Jun 03 10:02:45.715166 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 335/707] 10.222.0.45 () {60 vars in 1279 bytes} [Fri Jun 3 10:02:45 2022] DELETE /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 03 10:02:45.723810 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-c924c707-d9a3-4b08-a790-12c3844549a3 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:45.724427 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-c924c707-d9a3-4b08-a790-12c3844549a3 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:45.730515 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c924c707-d9a3-4b08-a790-12c3844549a3 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:45.730960 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c924c707-d9a3-4b08-a790-12c3844549a3 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:45.731718 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c924c707-d9a3-4b08-a790-12c3844549a3 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:45.732151 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c924c707-d9a3-4b08-a790-12c3844549a3 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:45.869184 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-c924c707-d9a3-4b08-a790-12c3844549a3 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:45.884274 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-c924c707-d9a3-4b08-a790-12c3844549a3 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:45.886067 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-c924c707-d9a3-4b08-a790-12c3844549a3 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:45.895653 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-c924c707-d9a3-4b08-a790-12c3844549a3 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1723 microversion: 2.20 time: 0.167817 Jun 03 10:02:45.898570 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 373/708] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:02:45 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:02:46.322502 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-00a02764-5f81-4f36-a1f7-c24f6db38f59 req-f8c07747-e34a-4cde-8369-f226191c50ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef716191-e303-4e00-a92c-78d4fb06063f", "tag": "1567f4c3-0049-47d8-914a-22f5172d29dc"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:02:46.332833 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-00a02764-5f81-4f36-a1f7-c24f6db38f59 req-f8c07747-e34a-4cde-8369-f226191c50ab service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:46.333279 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-00a02764-5f81-4f36-a1f7-c24f6db38f59 req-f8c07747-e34a-4cde-8369-f226191c50ab service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:46.347972 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-00a02764-5f81-4f36-a1f7-c24f6db38f59 req-f8c07747-e34a-4cde-8369-f226191c50ab service nova] Creating event network-changed:1567f4c3-0049-47d8-914a-22f5172d29dc for instance ef716191-e303-4e00-a92c-78d4fb06063f on hv-cinder-79760 Jun 03 10:02:46.352802 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-00a02764-5f81-4f36-a1f7-c24f6db38f59 req-f8c07747-e34a-4cde-8369-f226191c50ab service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034702 Jun 03 10:02:46.353402 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 336/709] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 10:02:46.642947 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-1203f169-8a4d-45b0-af81-877a444d2ce4 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:46.643974 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-1203f169-8a4d-45b0-af81-877a444d2ce4 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:46.650803 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1203f169-8a4d-45b0-af81-877a444d2ce4 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:46.651255 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1203f169-8a4d-45b0-af81-877a444d2ce4 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:46.652035 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1203f169-8a4d-45b0-af81-877a444d2ce4 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:46.652497 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1203f169-8a4d-45b0-af81-877a444d2ce4 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:46.682464 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-1203f169-8a4d-45b0-af81-877a444d2ce4 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044110 Jun 03 10:02:46.683044 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 374/710] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 3 10:02:46 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:02:46.919873 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-1906cfa3-7ae1-467f-b478-f223db1b7db5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:46.920525 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-1906cfa3-7ae1-467f-b478-f223db1b7db5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:46.926699 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1906cfa3-7ae1-467f-b478-f223db1b7db5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:46.927146 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1906cfa3-7ae1-467f-b478-f223db1b7db5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:46.927977 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1906cfa3-7ae1-467f-b478-f223db1b7db5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:46.928425 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1906cfa3-7ae1-467f-b478-f223db1b7db5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:47.067214 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-1906cfa3-7ae1-467f-b478-f223db1b7db5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:47.076334 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-1906cfa3-7ae1-467f-b478-f223db1b7db5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:47.078507 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-1906cfa3-7ae1-467f-b478-f223db1b7db5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:47.079781 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-1906cfa3-7ae1-467f-b478-f223db1b7db5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1723 microversion: 2.20 time: 0.164883 Jun 03 10:02:47.080356 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 337/711] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:02:46 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:02:47.694477 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-3010d4e8-9643-46e2-bfa4-8bed856ed547 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:47.695471 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-3010d4e8-9643-46e2-bfa4-8bed856ed547 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:47.702179 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3010d4e8-9643-46e2-bfa4-8bed856ed547 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:47.702636 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3010d4e8-9643-46e2-bfa4-8bed856ed547 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:47.703436 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3010d4e8-9643-46e2-bfa4-8bed856ed547 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:47.703903 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3010d4e8-9643-46e2-bfa4-8bed856ed547 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:47.731975 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-3010d4e8-9643-46e2-bfa4-8bed856ed547 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041453 Jun 03 10:02:47.732524 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 375/712] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 3 10:02:47 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:02:48.099486 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-e82bce85-a5d5-421e-aedf-e1c63bfd5743 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:48.100022 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-e82bce85-a5d5-421e-aedf-e1c63bfd5743 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:48.106549 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e82bce85-a5d5-421e-aedf-e1c63bfd5743 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:48.106999 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e82bce85-a5d5-421e-aedf-e1c63bfd5743 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:48.107766 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e82bce85-a5d5-421e-aedf-e1c63bfd5743 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:48.108203 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e82bce85-a5d5-421e-aedf-e1c63bfd5743 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:48.253947 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-e82bce85-a5d5-421e-aedf-e1c63bfd5743 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:48.263410 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-e82bce85-a5d5-421e-aedf-e1c63bfd5743 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:48.265112 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-e82bce85-a5d5-421e-aedf-e1c63bfd5743 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:48.266466 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-e82bce85-a5d5-421e-aedf-e1c63bfd5743 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1723 microversion: 2.20 time: 0.170996 Jun 03 10:02:48.267095 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 338/713] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:02:48 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:02:48.749456 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-a23b9e26-e747-4841-aac2-4a233346fdeb tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:48.750393 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-a23b9e26-e747-4841-aac2-4a233346fdeb tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:48.757704 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a23b9e26-e747-4841-aac2-4a233346fdeb tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:48.758182 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a23b9e26-e747-4841-aac2-4a233346fdeb tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:48.758947 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a23b9e26-e747-4841-aac2-4a233346fdeb tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:48.759377 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a23b9e26-e747-4841-aac2-4a233346fdeb tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:48.787238 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-a23b9e26-e747-4841-aac2-4a233346fdeb tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041845 Jun 03 10:02:48.787780 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 376/714] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 3 10:02:48 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:02:49.287489 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-966d738c-e1be-469b-874a-cca4d4debbe7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:49.288158 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-966d738c-e1be-469b-874a-cca4d4debbe7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:49.294587 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-966d738c-e1be-469b-874a-cca4d4debbe7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:49.295027 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-966d738c-e1be-469b-874a-cca4d4debbe7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:49.295798 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-966d738c-e1be-469b-874a-cca4d4debbe7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:49.296315 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-966d738c-e1be-469b-874a-cca4d4debbe7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:49.434945 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-966d738c-e1be-469b-874a-cca4d4debbe7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:49.443016 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-966d738c-e1be-469b-874a-cca4d4debbe7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:49.444508 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-966d738c-e1be-469b-874a-cca4d4debbe7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:49.445664 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-966d738c-e1be-469b-874a-cca4d4debbe7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1723 microversion: 2.20 time: 0.162355 Jun 03 10:02:49.446287 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 339/715] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:02:49 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 10:02:49.798881 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-ebb0fc87-f77b-4ee7-be32-73e5506a2521 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:49.799752 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-ebb0fc87-f77b-4ee7-be32-73e5506a2521 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:49.806915 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ebb0fc87-f77b-4ee7-be32-73e5506a2521 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:49.807421 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ebb0fc87-f77b-4ee7-be32-73e5506a2521 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:49.808270 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ebb0fc87-f77b-4ee7-be32-73e5506a2521 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:49.808714 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ebb0fc87-f77b-4ee7-be32-73e5506a2521 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:49.843919 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-ebb0fc87-f77b-4ee7-be32-73e5506a2521 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048895 Jun 03 10:02:49.844557 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 377/716] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 3 10:02:49 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:02:50.464360 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-441f7678-1d13-467a-b130-8664a81e4ca9 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:50.465018 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-441f7678-1d13-467a-b130-8664a81e4ca9 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:50.472546 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-441f7678-1d13-467a-b130-8664a81e4ca9 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:50.472992 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-441f7678-1d13-467a-b130-8664a81e4ca9 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:50.473775 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-441f7678-1d13-467a-b130-8664a81e4ca9 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:50.474210 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-441f7678-1d13-467a-b130-8664a81e4ca9 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:50.754190 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-441f7678-1d13-467a-b130-8664a81e4ca9 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:50.765646 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-441f7678-1d13-467a-b130-8664a81e4ca9 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:50.768768 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-441f7678-1d13-467a-b130-8664a81e4ca9 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:50.771004 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-441f7678-1d13-467a-b130-8664a81e4ca9 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1656 microversion: 2.20 time: 0.310155 Jun 03 10:02:50.772290 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 340/717] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:02:50 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1656 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:02:50.856541 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-c9c85a31-ebfc-48ef-9bd1-ab9cb9449d46 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:50.857484 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-c9c85a31-ebfc-48ef-9bd1-ab9cb9449d46 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:50.870252 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c9c85a31-ebfc-48ef-9bd1-ab9cb9449d46 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:50.871119 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c9c85a31-ebfc-48ef-9bd1-ab9cb9449d46 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:50.873672 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c9c85a31-ebfc-48ef-9bd1-ab9cb9449d46 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:50.874153 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c9c85a31-ebfc-48ef-9bd1-ab9cb9449d46 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:51.018495 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-ce70cf67-3e07-4607-bd48-bc96b0457d40 req-b708a6f8-6dd4-4a9c-ad57-f6e40d1abdb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f", "name": "network-vif-deleted", "tag": "d6b08e27-3091-4087-a29a-03ef6cbbdc0a"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:02:51.035099 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-ce70cf67-3e07-4607-bd48-bc96b0457d40 req-b708a6f8-6dd4-4a9c-ad57-f6e40d1abdb3 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:51.035786 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-ce70cf67-3e07-4607-bd48-bc96b0457d40 req-b708a6f8-6dd4-4a9c-ad57-f6e40d1abdb3 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:51.049563 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-ce70cf67-3e07-4607-bd48-bc96b0457d40 req-b708a6f8-6dd4-4a9c-ad57-f6e40d1abdb3 service nova] Creating event network-vif-deleted:d6b08e27-3091-4087-a29a-03ef6cbbdc0a for instance 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f on hv-cinder-79760 Jun 03 10:02:51.055891 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-ce70cf67-3e07-4607-bd48-bc96b0457d40 req-b708a6f8-6dd4-4a9c-ad57-f6e40d1abdb3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044418 Jun 03 10:02:51.057147 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 341/718] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:02:51.108238 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-c9c85a31-ebfc-48ef-9bd1-ab9cb9449d46 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.255575 Jun 03 10:02:51.109050 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 378/719] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 3 10:02:50 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f/os-volume_attachments => generated 25 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 10:02:51.126618 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-8e40c670-f328-48d2-a1ab-dee831b7b780 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:51.127613 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-8e40c670-f328-48d2-a1ab-dee831b7b780 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:51.134252 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8e40c670-f328-48d2-a1ab-dee831b7b780 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:51.135036 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8e40c670-f328-48d2-a1ab-dee831b7b780 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:51.136411 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8e40c670-f328-48d2-a1ab-dee831b7b780 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:51.136986 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8e40c670-f328-48d2-a1ab-dee831b7b780 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:51.248247 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.wsgi [None req-8e40c670-f328-48d2-a1ab-dee831b7b780 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] HTTP exception thrown: Instance ef716191-e303-4e00-a92c-78d4fb06063f is not attached to volume e7fa8335-7b82-43c0-86ea-c6d74fdcdefc Jun 03 10:02:51.256739 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-8e40c670-f328-48d2-a1ab-dee831b7b780 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Request method failure captured: Jun 03 10:02:51.256739 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: request: DELETE /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f/os-volume_attachments/e7fa8335-7b82-43c0-86ea-c6d74fdcdefc HTTP/1.1 Jun 03 10:02:51.256739 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept: application/json Jun 03 10:02:51.256739 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept-Encoding: identity Jun 03 10:02:51.256739 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Connection: close Jun 03 10:02:51.256739 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Length: 0 Jun 03 10:02:51.256739 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Type: application/json Jun 03 10:02:51.256739 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Host: 10.222.0.45 Jun 03 10:02:51.256739 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Openstack-System-Scope: None Jun 03 10:02:51.256739 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: User-Agent: python-urllib3/1.26.9 Jun 03 10:02:51.256739 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Auth-Token: gAAAAABimdtIBCXJ4MFc_rdwaQ7Bui7XmrKviwsxsHnpKol3Imxaj8J5ZC84M4ob657y5K583r5X4k0y4wn8dtdl7h4ZCR4WJhUlRsdY59Y1w1ziceXbyLY3fkVQ9_AL69asuLoDKTDhnMtcJEY9c0Ikwny3dUJqVKQe6VjfEEJmu_dKvxX_tG8 Jun 03 10:02:51.256739 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Id: None Jun 03 10:02:51.256739 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Name: None Jun 03 10:02:51.256739 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Identity-Status: Confirmed Jun 03 10:02:51.256739 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Is-Admin-Project: True Jun 03 10:02:51.256739 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Id: default Jun 03 10:02:51.256739 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Name: Default Jun 03 10:02:51.256739 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Id: d3c4a1843a98436c81df8111244795ac Jun 03 10:02:51.256739 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Name: tempest-TestMinimumBasicScenario-1615010603 Jun 03 10:02:51.256739 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Role: member,reader Jun 03 10:02:51.256739 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Roles: member,reader Jun 03 10:02:51.258550 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d3c4a1843a98436c81df8111244795ac", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d3c4a1843a98436c81df8111244795ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d3c4a1843a98436c81df8111244795ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d3c4a1843a98436c81df8111244795ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 10:02:51.258550 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant: tempest-TestMinimumBasicScenario-1615010603 Jun 03 10:02:51.258550 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Id: d3c4a1843a98436c81df8111244795ac Jun 03 10:02:51.258550 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1615010603 Jun 03 10:02:51.258550 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User: tempest-TestMinimumBasicScenario-1615010603-project Jun 03 10:02:51.258550 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Id: default Jun 03 10:02:51.258550 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Name: Default Jun 03 10:02:51.258550 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Id: 7f67bf225f3a4ac5bcf07dde077101fd Jun 03 10:02:51.258550 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Name: tempest-TestMinimumBasicScenario-1615010603-project Jun 03 10:02:51.258550 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: method: > Jun 03 10:02:51.258550 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: exception: Instance ef716191-e303-4e00-a92c-78d4fb06063f is not attached to volume e7fa8335-7b82-43c0-86ea-c6d74fdcdefc Jun 03 10:02:51.259404 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: action_args: {'server_id': 'ef716191-e303-4e00-a92c-78d4fb06063f', 'id': 'e7fa8335-7b82-43c0-86ea-c6d74fdcdefc'} Jun 03 10:02:51.259404 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:02:51.259404 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:02:51.259404 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 03 10:02:51.259404 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 03 10:02:51.259404 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 03 10:02:51.259404 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 03 10:02:51.259404 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 03 10:02:51.259404 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 03 10:02:51.259404 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id e7fa8335-7b82-43c0-86ea-c6d74fdcdefc. Jun 03 10:02:51.259404 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:02:51.259404 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:02:51.259404 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:02:51.259404 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:02:51.259404 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:02:51.259404 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:02:51.259404 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:02:51.259404 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:02:51.259404 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:02:51.260913 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:02:51.260913 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 03 10:02:51.260913 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 03 10:02:51.260913 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef716191-e303-4e00-a92c-78d4fb06063f is not attached to volume e7fa8335-7b82-43c0-86ea-c6d74fdcdefc Jun 03 10:02:51.260913 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:02:51.260913 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:02:51.260913 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:02:51.260913 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:02:51.260913 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:02:51.260913 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:02:51.260913 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:02:51.260913 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:02:51.260913 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef716191-e303-4e00-a92c-78d4fb06063f is not attached to volume e7fa8335-7b82-43c0-86ea-c6d74fdcdefc Jun 03 10:02:51.260913 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:02:51.263276 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-8e40c670-f328-48d2-a1ab-dee831b7b780 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Returning 404 to user: Instance ef716191-e303-4e00-a92c-78d4fb06063f is not attached to volume e7fa8335-7b82-43c0-86ea-c6d74fdcdefc {{(pid=117648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:02:51.264680 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-8e40c670-f328-48d2-a1ab-dee831b7b780 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "DELETE /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f/os-volume_attachments/e7fa8335-7b82-43c0-86ea-c6d74fdcdefc" status: 404 len: 154 microversion: 2.1 time: 0.148781 Jun 03 10:02:51.268968 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 342/720] 10.222.0.45 () {58 vars in 1415 bytes} [Fri Jun 3 10:02:51 2022] DELETE /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f/os-volume_attachments/e7fa8335-7b82-43c0-86ea-c6d74fdcdefc => generated 154 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 10:02:51.791585 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-c7a3d595-2879-4f03-b2b1-760a758def29 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:51.793341 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-c7a3d595-2879-4f03-b2b1-760a758def29 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:51.801916 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c7a3d595-2879-4f03-b2b1-760a758def29 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:51.803267 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c7a3d595-2879-4f03-b2b1-760a758def29 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:51.804517 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c7a3d595-2879-4f03-b2b1-760a758def29 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:51.805317 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c7a3d595-2879-4f03-b2b1-760a758def29 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:51.848624 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c7a3d595-2879-4f03-b2b1-760a758def29 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:51.849365 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c7a3d595-2879-4f03-b2b1-760a758def29 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:51.850062 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.objects.instance [None req-c7a3d595-2879-4f03-b2b1-760a758def29 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lazy-loading 'fault' on Instance uuid 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f {{(pid=117647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:02:51.899825 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-c7a3d595-2879-4f03-b2b1-760a758def29 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:51.908709 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-c7a3d595-2879-4f03-b2b1-760a758def29 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:51.910561 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-c7a3d595-2879-4f03-b2b1-760a758def29 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:51.911722 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-c7a3d595-2879-4f03-b2b1-760a758def29 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 200 len: 1372 microversion: 2.20 time: 0.124851 Jun 03 10:02:51.912287 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 379/721] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:02:51 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 1372 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:02:52.418930 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-8de8890c-da1e-4371-aae3-af7cf22443dd tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:52.419471 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-8de8890c-da1e-4371-aae3-af7cf22443dd tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:52.426492 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8de8890c-da1e-4371-aae3-af7cf22443dd tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:52.426941 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8de8890c-da1e-4371-aae3-af7cf22443dd tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:52.427762 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8de8890c-da1e-4371-aae3-af7cf22443dd tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:52.428198 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8de8890c-da1e-4371-aae3-af7cf22443dd tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:52.452092 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-8de8890c-da1e-4371-aae3-af7cf22443dd tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Going to try to terminate instance {{(pid=117648) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 10:02:52.525022 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-8de8890c-da1e-4371-aae3-af7cf22443dd tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "DELETE /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 204 len: 0 microversion: 2.1 time: 0.109571 Jun 03 10:02:52.525727 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 343/722] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jun 3 10:02:52 2022] DELETE /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 10:02:52.535471 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-964f95fc-e7eb-4a2f-98f5-7db44c325d82 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:52.536584 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-964f95fc-e7eb-4a2f-98f5-7db44c325d82 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:52.543759 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-964f95fc-e7eb-4a2f-98f5-7db44c325d82 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:52.544214 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-964f95fc-e7eb-4a2f-98f5-7db44c325d82 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:52.545035 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-964f95fc-e7eb-4a2f-98f5-7db44c325d82 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:52.545536 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-964f95fc-e7eb-4a2f-98f5-7db44c325d82 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:52.676054 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-964f95fc-e7eb-4a2f-98f5-7db44c325d82 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:52.683831 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-964f95fc-e7eb-4a2f-98f5-7db44c325d82 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1551 microversion: 2.1 time: 0.153845 Jun 03 10:02:52.684395 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 380/723] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:52 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1551 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:52.931926 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-b55bb99e-c483-41aa-aec1-ee81f3ad2719 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:52.932565 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-b55bb99e-c483-41aa-aec1-ee81f3ad2719 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:52.938777 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b55bb99e-c483-41aa-aec1-ee81f3ad2719 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:52.939253 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b55bb99e-c483-41aa-aec1-ee81f3ad2719 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:52.940027 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b55bb99e-c483-41aa-aec1-ee81f3ad2719 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:52.940461 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b55bb99e-c483-41aa-aec1-ee81f3ad2719 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:52.954017 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.wsgi [None req-b55bb99e-c483-41aa-aec1-ee81f3ad2719 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] HTTP exception thrown: Instance 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f could not be found. Jun 03 10:02:52.955606 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-b55bb99e-c483-41aa-aec1-ee81f3ad2719 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Request method failure captured: Jun 03 10:02:52.955606 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: request: GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f HTTP/1.1 Jun 03 10:02:52.955606 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept: application/json Jun 03 10:02:52.955606 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept-Encoding: identity Jun 03 10:02:52.955606 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Connection: close Jun 03 10:02:52.955606 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Length: 0 Jun 03 10:02:52.955606 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Type: application/json Jun 03 10:02:52.955606 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Host: 10.222.0.45 Jun 03 10:02:52.955606 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Openstack-System-Scope: None Jun 03 10:02:52.955606 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: User-Agent: python-urllib3/1.26.9 Jun 03 10:02:52.955606 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Auth-Token: gAAAAABimdrgYo-2Vx1ptXxuKskbsQP5xFp5LSYXxmUHaCucaaECgXqrofnYb6vFB0tvZ4-fuxC8WTFRs8zAaTayArTmZc193duu9m3yB5hBoanJOO16UmLM5QOPyhwq-HXhz7PJYHuC4UtHNwgnImpfgr-j4c0Y71voljIc6V56F_OoloPswpY Jun 03 10:02:52.955606 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Id: None Jun 03 10:02:52.955606 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Name: None Jun 03 10:02:52.955606 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Identity-Status: Confirmed Jun 03 10:02:52.955606 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Is-Admin-Project: True Jun 03 10:02:52.955606 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Openstack-Nova-Api-Version: 2.20 Jun 03 10:02:52.955606 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Id: default Jun 03 10:02:52.955606 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Name: Default Jun 03 10:02:52.955606 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Id: a937f473cd1b44bc8d628c7cadb18856 Jun 03 10:02:52.955606 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-656044302 Jun 03 10:02:52.955606 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Role: member,reader Jun 03 10:02:52.955606 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Roles: member,reader Jun 03 10:02:52.957236 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a937f473cd1b44bc8d628c7cadb18856", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a937f473cd1b44bc8d628c7cadb18856"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a937f473cd1b44bc8d628c7cadb18856"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a937f473cd1b44bc8d628c7cadb18856"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 10:02:52.957236 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant: tempest-AttachVolumeShelveTestJSON-656044302 Jun 03 10:02:52.957236 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Id: a937f473cd1b44bc8d628c7cadb18856 Jun 03 10:02:52.957236 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-656044302 Jun 03 10:02:52.957236 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User: tempest-AttachVolumeShelveTestJSON-656044302-project Jun 03 10:02:52.957236 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Id: default Jun 03 10:02:52.957236 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Name: Default Jun 03 10:02:52.957236 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Id: c216711b9e9b45f09f4917fe7b8275ab Jun 03 10:02:52.957236 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Name: tempest-AttachVolumeShelveTestJSON-656044302-project Jun 03 10:02:52.957236 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: method: > Jun 03 10:02:52.957236 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: exception: Instance 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f could not be found. Jun 03 10:02:52.957236 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: action_args: {'id': '5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f'} Jun 03 10:02:52.958148 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:02:52.958148 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:02:52.958148 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:02:52.958148 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:02:52.958148 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:02:52.958148 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:02:52.958148 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:02:52.958148 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:02:52.958148 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:02:52.958148 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:02:52.958148 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f could not be found. Jun 03 10:02:52.958148 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:02:52.958148 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:02:52.958148 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:02:52.958148 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:02:52.958148 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:02:52.958148 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:02:52.958148 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:02:52.958148 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:02:52.958148 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:02:52.959327 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:02:52.959327 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:02:52.959327 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:02:52.959327 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:02:52.959327 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:02:52.959327 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:02:52.959327 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:02:52.959327 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f could not be found. Jun 03 10:02:52.959327 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:02:52.959327 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:02:52.959327 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:02:52.959327 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:02:52.959327 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:02:52.959327 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:02:52.959327 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:02:52.959327 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:02:52.959327 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f could not be found. Jun 03 10:02:52.959327 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:02:52.960399 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-b55bb99e-c483-41aa-aec1-ee81f3ad2719 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Returning 404 to user: Instance 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f could not be found. {{(pid=117648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:02:52.960399 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-b55bb99e-c483-41aa-aec1-ee81f3ad2719 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 404 len: 111 microversion: 2.20 time: 0.029446 Jun 03 10:02:52.960399 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 344/724] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:02:52 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 03 10:02:52.965607 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-5bb0a1b5-8587-4b72-b8f6-6a597fe8b4c8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '.version_select at 0x7f5036b0fdc0>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:52.983659 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-5bb0a1b5-8587-4b72-b8f6-6a597fe8b4c8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2025725492" status: 204 len: 0 microversion: 2.20 time: 0.021825 Jun 03 10:02:52.984341 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 381/725] 10.222.0.45 () {60 vars in 1261 bytes} [Fri Jun 3 10:02:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2025725492 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 03 10:02:53.631029 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-dae7a080-9958-4857-9b26-d07d06d54383 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Action: 'create', calling method: .version_select at 0x7f5036a92790>, body: {"keypair": {"name": "tempest-keypair-1696527609", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDa0DQ/gpb2vPKgMED9gIWb5ye7KWRGPcspDKvq6Uk60oG+NZGMWtZo/ThRplHuXW3hS6HCSu7JsYdiVM+12QoQjtcamCqegHNJjR/lQ11UHez4snx0SQwqfT+JaXWQWwQ=="}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:02:53.645207 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-dae7a080-9958-4857-9b26-d07d06d54383 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Getting quotas for project a937f473cd1b44bc8d628c7cadb18856. Resources: {'key_pairs'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 10:02:53.649032 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-dae7a080-9958-4857-9b26-d07d06d54383 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Getting quotas for user c216711b9e9b45f09f4917fe7b8275ab and project a937f473cd1b44bc8d628c7cadb18856. Resources: {'key_pairs'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 10:02:53.670266 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-dae7a080-9958-4857-9b26-d07d06d54383 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.043007 Jun 03 10:02:53.678415 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 345/726] 10.222.0.45 () {62 vars in 1199 bytes} [Fri Jun 3 10:02:53 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 44 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 03 10:02:53.701092 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-6d3cfd39-ecff-49e3-a144-268ae93f3c37 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:53.701893 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-6d3cfd39-ecff-49e3-a144-268ae93f3c37 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:53.708785 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6d3cfd39-ecff-49e3-a144-268ae93f3c37 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:53.709293 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6d3cfd39-ecff-49e3-a144-268ae93f3c37 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:53.710132 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6d3cfd39-ecff-49e3-a144-268ae93f3c37 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:53.710569 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6d3cfd39-ecff-49e3-a144-268ae93f3c37 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:53.848779 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-6d3cfd39-ecff-49e3-a144-268ae93f3c37 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:53.856570 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-6d3cfd39-ecff-49e3-a144-268ae93f3c37 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1551 microversion: 2.1 time: 0.159942 Jun 03 10:02:53.857273 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 382/727] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:53 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1551 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:54.875768 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-8875e547-8663-4248-bd9d-efcea5347a61 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:54.876430 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-8875e547-8663-4248-bd9d-efcea5347a61 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:54.888497 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8875e547-8663-4248-bd9d-efcea5347a61 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:54.888961 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8875e547-8663-4248-bd9d-efcea5347a61 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:54.889781 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8875e547-8663-4248-bd9d-efcea5347a61 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:54.890821 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8875e547-8663-4248-bd9d-efcea5347a61 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:54.928943 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-b288600a-c292-4130-bd69-ce887f91dd1d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1444083376", "imageRef": "0cb3b007-4e95-448b-8acb-895d8acdb244", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "49acf399-babc-4227-8840-e015148cac86"}], "security_groups": [{"name": "tempest-securitygroup--104605056"}], "key_name": "tempest-keypair-1696527609", "user_data": "}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:02:55.053087 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-8875e547-8663-4248-bd9d-efcea5347a61 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:55.059491 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.network.neutron [None req-b288600a-c292-4130-bd69-ce887f91dd1d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] validate_networks() for [('49acf399-babc-4227-8840-e015148cac86', None, None, None, None, None)] {{(pid=117647) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 10:02:55.061312 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-8875e547-8663-4248-bd9d-efcea5347a61 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1551 microversion: 2.1 time: 0.190542 Jun 03 10:02:55.062473 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 346/728] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:54 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1551 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:55.418483 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-b288600a-c292-4130-bd69-ce887f91dd1d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Flavor limits 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 10:02:55.418913 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-b288600a-c292-4130-bd69-ce887f91dd1d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Image limits 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 10:02:55.419390 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-b288600a-c292-4130-bd69-ce887f91dd1d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Flavor pref 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 10:02:55.419838 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-b288600a-c292-4130-bd69-ce887f91dd1d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Image pref 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 10:02:55.420280 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-b288600a-c292-4130-bd69-ce887f91dd1d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 10:02:55.430107 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b288600a-c292-4130-bd69-ce887f91dd1d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:55.430556 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b288600a-c292-4130-bd69-ce887f91dd1d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:55.431350 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b288600a-c292-4130-bd69-ce887f91dd1d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:55.431785 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b288600a-c292-4130-bd69-ce887f91dd1d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:55.448110 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-b288600a-c292-4130-bd69-ce887f91dd1d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Getting quotas for project a937f473cd1b44bc8d628c7cadb18856. Resources: {'ram', 'cores', 'instances'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 10:02:55.452058 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-b288600a-c292-4130-bd69-ce887f91dd1d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Getting quotas for user c216711b9e9b45f09f4917fe7b8275ab and project a937f473cd1b44bc8d628c7cadb18856. Resources: {'ram', 'cores', 'instances'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 10:02:55.463153 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-b288600a-c292-4130-bd69-ce887f91dd1d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Going to run 1 instances... {{(pid=117647) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 10:02:55.465360 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-b288600a-c292-4130-bd69-ce887f91dd1d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0cb3b007-4e95-448b-8acb-895d8acdb244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 10:02:55.511709 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-b288600a-c292-4130-bd69-ce887f91dd1d tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.586979 Jun 03 10:02:55.512354 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 383/729] 10.222.0.45 () {62 vars in 1187 bytes} [Fri Jun 3 10:02:54 2022] POST /compute/v2.1/servers => generated 401 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 03 10:02:55.522443 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-88fd6a55-a906-4c68-b67c-cd4ecf843c0c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:55.523059 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-88fd6a55-a906-4c68-b67c-cd4ecf843c0c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:55.583228 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-88fd6a55-a906-4c68-b67c-cd4ecf843c0c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:55.590630 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-88fd6a55-a906-4c68-b67c-cd4ecf843c0c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:55.592133 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-88fd6a55-a906-4c68-b67c-cd4ecf843c0c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:55.593805 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-88fd6a55-a906-4c68-b67c-cd4ecf843c0c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1282 microversion: 2.20 time: 0.074746 Jun 03 10:02:55.601835 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 347/730] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:02:55 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1282 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:02:56.072400 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-2d78a685-0d2a-4304-8e0a-925c668f7993 req-d8df3e6c-3ade-4812-8e37-77e2c4ae48fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef716191-e303-4e00-a92c-78d4fb06063f", "name": "network-vif-deleted", "tag": "1567f4c3-0049-47d8-914a-22f5172d29dc"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:02:56.078796 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-bdb94777-0762-439d-b2f4-14319cba579c tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:56.079409 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-bdb94777-0762-439d-b2f4-14319cba579c tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:56.081991 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-2d78a685-0d2a-4304-8e0a-925c668f7993 req-d8df3e6c-3ade-4812-8e37-77e2c4ae48fb service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:56.082444 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-2d78a685-0d2a-4304-8e0a-925c668f7993 req-d8df3e6c-3ade-4812-8e37-77e2c4ae48fb service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:56.085903 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-bdb94777-0762-439d-b2f4-14319cba579c tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:56.086357 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-bdb94777-0762-439d-b2f4-14319cba579c tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:56.087116 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-bdb94777-0762-439d-b2f4-14319cba579c tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:56.087551 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-bdb94777-0762-439d-b2f4-14319cba579c tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:56.092537 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:02:56.093212 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-2d78a685-0d2a-4304-8e0a-925c668f7993 req-d8df3e6c-3ade-4812-8e37-77e2c4ae48fb service nova] Creating event network-vif-deleted:1567f4c3-0049-47d8-914a-22f5172d29dc for instance ef716191-e303-4e00-a92c-78d4fb06063f on hv-cinder-79760 Jun 03 10:02:56.098547 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-2d78a685-0d2a-4304-8e0a-925c668f7993 req-d8df3e6c-3ade-4812-8e37-77e2c4ae48fb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029914 Jun 03 10:02:56.099287 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 384/731] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:02:56.167785 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-bdb94777-0762-439d-b2f4-14319cba579c tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:56.183850 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-bdb94777-0762-439d-b2f4-14319cba579c tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1509 microversion: 2.1 time: 0.108838 Jun 03 10:02:56.184421 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 348/732] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:56 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1509 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:02:56.612502 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-ab3ff49b-3785-4947-af76-ecf33cf7a9d2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:56.613117 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-ab3ff49b-3785-4947-af76-ecf33cf7a9d2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:56.619415 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ab3ff49b-3785-4947-af76-ecf33cf7a9d2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:56.619867 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ab3ff49b-3785-4947-af76-ecf33cf7a9d2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:56.620632 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ab3ff49b-3785-4947-af76-ecf33cf7a9d2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:56.621073 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ab3ff49b-3785-4947-af76-ecf33cf7a9d2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:56.686883 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-ab3ff49b-3785-4947-af76-ecf33cf7a9d2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:56.694806 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-ab3ff49b-3785-4947-af76-ecf33cf7a9d2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:56.696375 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-ab3ff49b-3785-4947-af76-ecf33cf7a9d2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:56.697497 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-ab3ff49b-3785-4947-af76-ecf33cf7a9d2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1334 microversion: 2.20 time: 0.089349 Jun 03 10:02:56.698092 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 385/733] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:02:56 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1334 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:02:57.200653 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-0f8106b7-aebe-4d19-82bb-5cd8924fd6f1 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:57.201276 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-0f8106b7-aebe-4d19-82bb-5cd8924fd6f1 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:57.208617 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0f8106b7-aebe-4d19-82bb-5cd8924fd6f1 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:57.209321 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0f8106b7-aebe-4d19-82bb-5cd8924fd6f1 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:57.210298 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0f8106b7-aebe-4d19-82bb-5cd8924fd6f1 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:57.210744 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0f8106b7-aebe-4d19-82bb-5cd8924fd6f1 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:57.245135 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0f8106b7-aebe-4d19-82bb-5cd8924fd6f1 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:57.245579 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0f8106b7-aebe-4d19-82bb-5cd8924fd6f1 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:57.246237 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.objects.instance [None req-0f8106b7-aebe-4d19-82bb-5cd8924fd6f1 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lazy-loading 'fault' on Instance uuid ef716191-e303-4e00-a92c-78d4fb06063f {{(pid=117648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:02:57.295126 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-0f8106b7-aebe-4d19-82bb-5cd8924fd6f1 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f67bf225f3a4ac5bcf07dde077101fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3c4a1843a98436c81df8111244795ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:57.305594 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-0f8106b7-aebe-4d19-82bb-5cd8924fd6f1 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 200 len: 1347 microversion: 2.1 time: 0.108892 Jun 03 10:02:57.306927 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 349/734] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:57 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 1347 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:02:57.715330 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-6edb1ad5-416f-47e6-b33d-d6bc2ff44a40 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:57.716049 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-6edb1ad5-416f-47e6-b33d-d6bc2ff44a40 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:57.722596 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6edb1ad5-416f-47e6-b33d-d6bc2ff44a40 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:57.723042 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6edb1ad5-416f-47e6-b33d-d6bc2ff44a40 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:57.723802 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6edb1ad5-416f-47e6-b33d-d6bc2ff44a40 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:57.724241 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6edb1ad5-416f-47e6-b33d-d6bc2ff44a40 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:57.740751 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:02:57.790609 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-6edb1ad5-416f-47e6-b33d-d6bc2ff44a40 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:57.799292 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-6edb1ad5-416f-47e6-b33d-d6bc2ff44a40 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:57.800909 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-6edb1ad5-416f-47e6-b33d-d6bc2ff44a40 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:57.802152 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-6edb1ad5-416f-47e6-b33d-d6bc2ff44a40 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1340 microversion: 2.20 time: 0.090751 Jun 03 10:02:57.802706 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 386/735] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:02:57 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1340 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:02:58.322303 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-a10ab2e2-b904-4cd7-a9c9-42865543faf4 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:58.322830 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-a10ab2e2-b904-4cd7-a9c9-42865543faf4 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] [instance: ef716191-e303-4e00-a92c-78d4fb06063f] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:58.329289 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a10ab2e2-b904-4cd7-a9c9-42865543faf4 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:58.329743 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a10ab2e2-b904-4cd7-a9c9-42865543faf4 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:58.330539 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a10ab2e2-b904-4cd7-a9c9-42865543faf4 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:58.330975 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a10ab2e2-b904-4cd7-a9c9-42865543faf4 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:58.344197 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.wsgi [None req-a10ab2e2-b904-4cd7-a9c9-42865543faf4 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] HTTP exception thrown: Instance ef716191-e303-4e00-a92c-78d4fb06063f could not be found. Jun 03 10:02:58.345725 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-a10ab2e2-b904-4cd7-a9c9-42865543faf4 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Request method failure captured: Jun 03 10:02:58.345725 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: request: GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f HTTP/1.1 Jun 03 10:02:58.345725 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept: application/json Jun 03 10:02:58.345725 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept-Encoding: identity Jun 03 10:02:58.345725 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Connection: close Jun 03 10:02:58.345725 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Length: 0 Jun 03 10:02:58.345725 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Type: application/json Jun 03 10:02:58.345725 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Host: 10.222.0.45 Jun 03 10:02:58.345725 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Openstack-System-Scope: None Jun 03 10:02:58.345725 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: User-Agent: python-urllib3/1.26.9 Jun 03 10:02:58.345725 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Auth-Token: gAAAAABimdtIBCXJ4MFc_rdwaQ7Bui7XmrKviwsxsHnpKol3Imxaj8J5ZC84M4ob657y5K583r5X4k0y4wn8dtdl7h4ZCR4WJhUlRsdY59Y1w1ziceXbyLY3fkVQ9_AL69asuLoDKTDhnMtcJEY9c0Ikwny3dUJqVKQe6VjfEEJmu_dKvxX_tG8 Jun 03 10:02:58.345725 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Id: None Jun 03 10:02:58.345725 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Name: None Jun 03 10:02:58.345725 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Identity-Status: Confirmed Jun 03 10:02:58.345725 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Is-Admin-Project: True Jun 03 10:02:58.345725 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Id: default Jun 03 10:02:58.345725 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Name: Default Jun 03 10:02:58.345725 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Id: d3c4a1843a98436c81df8111244795ac Jun 03 10:02:58.345725 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Name: tempest-TestMinimumBasicScenario-1615010603 Jun 03 10:02:58.345725 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Role: member,reader Jun 03 10:02:58.345725 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Roles: member,reader Jun 03 10:02:58.347328 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d3c4a1843a98436c81df8111244795ac", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d3c4a1843a98436c81df8111244795ac"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d3c4a1843a98436c81df8111244795ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d3c4a1843a98436c81df8111244795ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 10:02:58.347328 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant: tempest-TestMinimumBasicScenario-1615010603 Jun 03 10:02:58.347328 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Id: d3c4a1843a98436c81df8111244795ac Jun 03 10:02:58.347328 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1615010603 Jun 03 10:02:58.347328 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User: tempest-TestMinimumBasicScenario-1615010603-project Jun 03 10:02:58.347328 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Id: default Jun 03 10:02:58.347328 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Name: Default Jun 03 10:02:58.347328 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Id: 7f67bf225f3a4ac5bcf07dde077101fd Jun 03 10:02:58.347328 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Name: tempest-TestMinimumBasicScenario-1615010603-project Jun 03 10:02:58.347328 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: method: > Jun 03 10:02:58.347328 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: exception: Instance ef716191-e303-4e00-a92c-78d4fb06063f could not be found. Jun 03 10:02:58.347328 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: action_args: {'id': 'ef716191-e303-4e00-a92c-78d4fb06063f'} Jun 03 10:02:58.348204 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:02:58.348204 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:02:58.348204 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:02:58.348204 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:02:58.348204 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:02:58.348204 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:02:58.348204 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:02:58.348204 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:02:58.348204 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:02:58.348204 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:02:58.348204 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef716191-e303-4e00-a92c-78d4fb06063f could not be found. Jun 03 10:02:58.348204 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:02:58.348204 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:02:58.348204 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:02:58.348204 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:02:58.348204 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:02:58.348204 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:02:58.348204 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:02:58.348204 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:02:58.348204 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:02:58.349633 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:02:58.349633 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:02:58.349633 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:02:58.349633 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:02:58.349633 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:02:58.349633 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:02:58.349633 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:02:58.349633 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef716191-e303-4e00-a92c-78d4fb06063f could not be found. Jun 03 10:02:58.349633 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:02:58.349633 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:02:58.349633 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:02:58.349633 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:02:58.349633 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:02:58.349633 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:02:58.349633 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:02:58.349633 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:02:58.349633 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef716191-e303-4e00-a92c-78d4fb06063f could not be found. Jun 03 10:02:58.349633 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:02:58.350958 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-a10ab2e2-b904-4cd7-a9c9-42865543faf4 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Returning 404 to user: Instance ef716191-e303-4e00-a92c-78d4fb06063f could not be found. {{(pid=117648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:02:58.350958 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-a10ab2e2-b904-4cd7-a9c9-42865543faf4 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f" status: 404 len: 111 microversion: 2.1 time: 0.028847 Jun 03 10:02:58.350958 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 350/736] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:02:58 2022] GET /compute/v2.1/servers/ef716191-e303-4e00-a92c-78d4fb06063f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 10:02:58.359946 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-f8eb12c8-0931-42a7-a28e-c7b18f9837c9 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] Calling method '.version_select at 0x7f5036b3eb80>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:58.378630 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-f8eb12c8-0931-42a7-a28e-c7b18f9837c9 tempest-TestMinimumBasicScenario-1615010603 tempest-TestMinimumBasicScenario-1615010603-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-781155472" status: 202 len: 0 microversion: 2.1 time: 0.022902 Jun 03 10:02:58.382301 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 387/737] 10.222.0.45 () {58 vars in 1268 bytes} [Fri Jun 3 10:02:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-781155472 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 10:02:58.800452 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-3289dde6-575a-4912-9c29-c28c43f23065 req-e37a3944-af24-4781-93ec-cd7cc843b30a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02de8459-bf38-485f-971a-d8f1d7909898", "tag": "5b00cee1-834c-4ff1-b027-9118ca362265"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:02:58.813151 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-3289dde6-575a-4912-9c29-c28c43f23065 req-e37a3944-af24-4781-93ec-cd7cc843b30a service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:58.814019 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-3289dde6-575a-4912-9c29-c28c43f23065 req-e37a3944-af24-4781-93ec-cd7cc843b30a service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:58.830050 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-94bd8e31-5dcb-4170-870f-be7974a15f2b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:02:58.830889 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-3289dde6-575a-4912-9c29-c28c43f23065 req-e37a3944-af24-4781-93ec-cd7cc843b30a service nova] Creating event network-changed:5b00cee1-834c-4ff1-b027-9118ca362265 for instance 02de8459-bf38-485f-971a-d8f1d7909898 on hv-cinder-79760 Jun 03 10:02:58.831491 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-94bd8e31-5dcb-4170-870f-be7974a15f2b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:02:58.838680 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-3289dde6-575a-4912-9c29-c28c43f23065 req-e37a3944-af24-4781-93ec-cd7cc843b30a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043398 Jun 03 10:02:58.840377 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 351/738] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:02:58.844810 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-94bd8e31-5dcb-4170-870f-be7974a15f2b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:58.845441 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-94bd8e31-5dcb-4170-870f-be7974a15f2b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:58.846431 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-94bd8e31-5dcb-4170-870f-be7974a15f2b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:02:58.847028 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-94bd8e31-5dcb-4170-870f-be7974a15f2b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:02:59.280142 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-94bd8e31-5dcb-4170-870f-be7974a15f2b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:59.291597 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-94bd8e31-5dcb-4170-870f-be7974a15f2b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:59.293374 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-94bd8e31-5dcb-4170-870f-be7974a15f2b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:02:59.294788 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-94bd8e31-5dcb-4170-870f-be7974a15f2b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1407 microversion: 2.20 time: 0.477996 Jun 03 10:02:59.295351 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 388/739] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:02:58 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1407 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 10:03:00.313990 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-77ec6141-ec64-4c74-9d79-b7767f958b40 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:00.314840 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-77ec6141-ec64-4c74-9d79-b7767f958b40 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:00.321136 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-77ec6141-ec64-4c74-9d79-b7767f958b40 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:00.321584 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-77ec6141-ec64-4c74-9d79-b7767f958b40 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:00.322390 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-77ec6141-ec64-4c74-9d79-b7767f958b40 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:00.322822 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-77ec6141-ec64-4c74-9d79-b7767f958b40 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:00.548161 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-77ec6141-ec64-4c74-9d79-b7767f958b40 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:00.556233 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-77ec6141-ec64-4c74-9d79-b7767f958b40 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:00.557763 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-77ec6141-ec64-4c74-9d79-b7767f958b40 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:00.558893 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-77ec6141-ec64-4c74-9d79-b7767f958b40 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1407 microversion: 2.20 time: 0.250168 Jun 03 10:03:00.559447 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 352/740] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:03:00 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1407 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:03:01.576876 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-649b34e0-690e-4226-b09d-d6cac1136462 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:01.578161 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-649b34e0-690e-4226-b09d-d6cac1136462 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:01.588062 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-649b34e0-690e-4226-b09d-d6cac1136462 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:01.588532 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-649b34e0-690e-4226-b09d-d6cac1136462 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:01.589328 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-649b34e0-690e-4226-b09d-d6cac1136462 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:01.589784 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-649b34e0-690e-4226-b09d-d6cac1136462 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:01.747311 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-649b34e0-690e-4226-b09d-d6cac1136462 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:01.756077 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-649b34e0-690e-4226-b09d-d6cac1136462 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:01.757592 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-649b34e0-690e-4226-b09d-d6cac1136462 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:01.758792 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-649b34e0-690e-4226-b09d-d6cac1136462 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1407 microversion: 2.20 time: 0.186041 Jun 03 10:03:01.759397 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 389/741] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:03:01 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:03:01.933325 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-4b771897-88a9-4e90-853b-6cb176a50fb9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:01.933855 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-4b771897-88a9-4e90-853b-6cb176a50fb9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:01.940949 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4b771897-88a9-4e90-853b-6cb176a50fb9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:01.941398 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4b771897-88a9-4e90-853b-6cb176a50fb9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:01.942285 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4b771897-88a9-4e90-853b-6cb176a50fb9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:01.942722 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4b771897-88a9-4e90-853b-6cb176a50fb9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:02.031410 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.objects.instance [None req-4b771897-88a9-4e90-853b-6cb176a50fb9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lazy-loading 'services' on Instance uuid fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 {{(pid=117648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:03:02.120367 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-4b771897-88a9-4e90-853b-6cb176a50fb9 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "DELETE /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6/os-volume_attachments/85398176-4b7b-4cdb-ae84-f80a34a24072" status: 202 len: 0 microversion: 2.1 time: 0.190202 Jun 03 10:03:02.121183 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 353/742] 10.222.0.45 () {58 vars in 1415 bytes} [Fri Jun 3 10:03:01 2022] DELETE /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6/os-volume_attachments/85398176-4b7b-4cdb-ae84-f80a34a24072 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 10:03:02.130643 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-26a410b3-ef41-4c67-9235-fc28ebaaf4e1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:02.131889 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-26a410b3-ef41-4c67-9235-fc28ebaaf4e1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:02.138786 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-26a410b3-ef41-4c67-9235-fc28ebaaf4e1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:02.139431 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-26a410b3-ef41-4c67-9235-fc28ebaaf4e1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:02.144890 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-26a410b3-ef41-4c67-9235-fc28ebaaf4e1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:02.145563 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-26a410b3-ef41-4c67-9235-fc28ebaaf4e1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:02.196353 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-26a410b3-ef41-4c67-9235-fc28ebaaf4e1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069638 Jun 03 10:03:02.197335 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 390/743] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 3 10:03:02 2022] GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:03:02.777830 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-e69b6d37-3a41-4a57-a02f-cbfcddae8fda tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:02.778796 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-e69b6d37-3a41-4a57-a02f-cbfcddae8fda tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:02.785812 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e69b6d37-3a41-4a57-a02f-cbfcddae8fda tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:02.786613 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e69b6d37-3a41-4a57-a02f-cbfcddae8fda tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:02.787633 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e69b6d37-3a41-4a57-a02f-cbfcddae8fda tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:02.788392 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e69b6d37-3a41-4a57-a02f-cbfcddae8fda tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:02.930201 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-e69b6d37-3a41-4a57-a02f-cbfcddae8fda tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:02.939137 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-e69b6d37-3a41-4a57-a02f-cbfcddae8fda tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:02.940669 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-e69b6d37-3a41-4a57-a02f-cbfcddae8fda tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:02.941838 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-e69b6d37-3a41-4a57-a02f-cbfcddae8fda tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1407 microversion: 2.20 time: 0.168279 Jun 03 10:03:02.952001 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 354/744] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:03:02 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:03:03.208804 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-fbc2fa20-0a6c-4407-8afb-858b3dd096a3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:03.209954 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-fbc2fa20-0a6c-4407-8afb-858b3dd096a3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:03.216972 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-fbc2fa20-0a6c-4407-8afb-858b3dd096a3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:03.217427 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-fbc2fa20-0a6c-4407-8afb-858b3dd096a3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:03.218762 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-fbc2fa20-0a6c-4407-8afb-858b3dd096a3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:03.219204 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-fbc2fa20-0a6c-4407-8afb-858b3dd096a3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:03.252076 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-fbc2fa20-0a6c-4407-8afb-858b3dd096a3 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047110 Jun 03 10:03:03.252789 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 391/745] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 3 10:03:03 2022] GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:03:03.779941 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-85f197f4-47a9-4208-a235-d7e32adb51a7 req-7e33c822-9141-4574-8071-311d53bf27a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02de8459-bf38-485f-971a-d8f1d7909898", "name": "network-vif-plugged", "status": "completed", "tag": "5b00cee1-834c-4ff1-b027-9118ca362265"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:03:03.790484 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-85f197f4-47a9-4208-a235-d7e32adb51a7 req-7e33c822-9141-4574-8071-311d53bf27a3 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:03.791010 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-85f197f4-47a9-4208-a235-d7e32adb51a7 req-7e33c822-9141-4574-8071-311d53bf27a3 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:03.805952 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-85f197f4-47a9-4208-a235-d7e32adb51a7 req-7e33c822-9141-4574-8071-311d53bf27a3 service nova] Creating event network-vif-plugged:5b00cee1-834c-4ff1-b027-9118ca362265 for instance 02de8459-bf38-485f-971a-d8f1d7909898 on hv-cinder-79760 Jun 03 10:03:03.813400 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-85f197f4-47a9-4208-a235-d7e32adb51a7 req-7e33c822-9141-4574-8071-311d53bf27a3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037281 Jun 03 10:03:03.814117 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 355/746] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:03:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:03:03.960674 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-6f901159-09ee-47c6-b51f-ae49b1ef7602 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:03.961923 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-6f901159-09ee-47c6-b51f-ae49b1ef7602 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:03.968507 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6f901159-09ee-47c6-b51f-ae49b1ef7602 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:03.969047 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6f901159-09ee-47c6-b51f-ae49b1ef7602 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:03.969987 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6f901159-09ee-47c6-b51f-ae49b1ef7602 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:03.970670 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6f901159-09ee-47c6-b51f-ae49b1ef7602 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:04.123291 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-6f901159-09ee-47c6-b51f-ae49b1ef7602 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:04.133075 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-6f901159-09ee-47c6-b51f-ae49b1ef7602 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:04.135288 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-6f901159-09ee-47c6-b51f-ae49b1ef7602 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:04.136545 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-6f901159-09ee-47c6-b51f-ae49b1ef7602 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1407 microversion: 2.20 time: 0.180705 Jun 03 10:03:04.137851 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 392/747] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:03:03 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:03:04.264798 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-e479bde0-a341-49a0-a085-a073b0a3c070 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:04.265765 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-e479bde0-a341-49a0-a085-a073b0a3c070 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:04.272220 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e479bde0-a341-49a0-a085-a073b0a3c070 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:04.272678 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e479bde0-a341-49a0-a085-a073b0a3c070 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:04.273453 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e479bde0-a341-49a0-a085-a073b0a3c070 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:04.273922 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e479bde0-a341-49a0-a085-a073b0a3c070 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:04.303880 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-e479bde0-a341-49a0-a085-a073b0a3c070 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043775 Jun 03 10:03:04.304468 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 356/748] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 3 10:03:04 2022] GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 10:03:04.382550 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-80403b48-2ef0-48c4-aaa7-59980824f6d5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:04.383139 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-80403b48-2ef0-48c4-aaa7-59980824f6d5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:04.389477 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-80403b48-2ef0-48c4-aaa7-59980824f6d5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:04.390422 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-80403b48-2ef0-48c4-aaa7-59980824f6d5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:04.391430 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-80403b48-2ef0-48c4-aaa7-59980824f6d5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:04.392076 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-80403b48-2ef0-48c4-aaa7-59980824f6d5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:04.418808 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-80403b48-2ef0-48c4-aaa7-59980824f6d5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Going to try to terminate instance {{(pid=117647) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 10:03:04.494343 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-80403b48-2ef0-48c4-aaa7-59980824f6d5 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "DELETE /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6" status: 204 len: 0 microversion: 2.1 time: 0.117197 Jun 03 10:03:04.498082 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 393/749] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jun 3 10:03:04 2022] DELETE /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 10:03:04.503045 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-50ca516e-17f9-4663-b757-0aa5ecfc4d0d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:04.503665 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-50ca516e-17f9-4663-b757-0aa5ecfc4d0d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:04.510099 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-50ca516e-17f9-4663-b757-0aa5ecfc4d0d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:04.510581 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-50ca516e-17f9-4663-b757-0aa5ecfc4d0d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:04.511354 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-50ca516e-17f9-4663-b757-0aa5ecfc4d0d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:04.511792 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-50ca516e-17f9-4663-b757-0aa5ecfc4d0d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:04.799649 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-50ca516e-17f9-4663-b757-0aa5ecfc4d0d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:04.807771 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-50ca516e-17f9-4663-b757-0aa5ecfc4d0d tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6" status: 200 len: 1688 microversion: 2.1 time: 0.307895 Jun 03 10:03:04.808350 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 357/750] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:04 2022] GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 => generated 1688 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:05.155487 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-247e9e2c-b77b-4749-b535-e87254d6a7cf tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:05.156202 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-247e9e2c-b77b-4749-b535-e87254d6a7cf tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:05.166863 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-247e9e2c-b77b-4749-b535-e87254d6a7cf tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:05.167324 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-247e9e2c-b77b-4749-b535-e87254d6a7cf tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:05.168108 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-247e9e2c-b77b-4749-b535-e87254d6a7cf tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:05.168550 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-247e9e2c-b77b-4749-b535-e87254d6a7cf tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:05.439897 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-247e9e2c-b77b-4749-b535-e87254d6a7cf tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:05.443245 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell0:SELECT=2 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:03:05.453352 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-247e9e2c-b77b-4749-b535-e87254d6a7cf tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:05.454908 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-247e9e2c-b77b-4749-b535-e87254d6a7cf tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:05.456027 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-247e9e2c-b77b-4749-b535-e87254d6a7cf tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1407 microversion: 2.20 time: 0.304940 Jun 03 10:03:05.456583 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 394/751] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:03:05 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1407 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:03:05.837039 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-1890cbcb-ac41-4537-8bb4-81d439a1fba6 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:05.837651 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-1890cbcb-ac41-4537-8bb4-81d439a1fba6 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:05.840191 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell0:SELECT=6 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:03:05.849508 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1890cbcb-ac41-4537-8bb4-81d439a1fba6 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:05.849994 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1890cbcb-ac41-4537-8bb4-81d439a1fba6 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:05.850780 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1890cbcb-ac41-4537-8bb4-81d439a1fba6 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:05.851216 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1890cbcb-ac41-4537-8bb4-81d439a1fba6 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:06.024275 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-1890cbcb-ac41-4537-8bb4-81d439a1fba6 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:06.033336 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-1890cbcb-ac41-4537-8bb4-81d439a1fba6 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6" status: 200 len: 1688 microversion: 2.1 time: 0.210477 Jun 03 10:03:06.033928 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 358/752] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:05 2022] GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 => generated 1688 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:06.474857 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-eed6811c-5bd4-4fea-b430-cfb9b297e340 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:06.475564 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-eed6811c-5bd4-4fea-b430-cfb9b297e340 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:06.477830 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell0:SELECT=6 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:03:06.487699 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-eed6811c-5bd4-4fea-b430-cfb9b297e340 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:06.488196 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-eed6811c-5bd4-4fea-b430-cfb9b297e340 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:06.489014 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-eed6811c-5bd4-4fea-b430-cfb9b297e340 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:06.489456 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-eed6811c-5bd4-4fea-b430-cfb9b297e340 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:06.633518 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-eed6811c-5bd4-4fea-b430-cfb9b297e340 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:06.642148 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-eed6811c-5bd4-4fea-b430-cfb9b297e340 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:06.643662 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-eed6811c-5bd4-4fea-b430-cfb9b297e340 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:06.644827 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-eed6811c-5bd4-4fea-b430-cfb9b297e340 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1407 microversion: 2.20 time: 0.174034 Jun 03 10:03:06.645389 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 395/753] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:03:06 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:03:07.050570 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-40d89cd4-d8e2-42fd-89a7-3b3a1b0a1200 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:07.051192 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-40d89cd4-d8e2-42fd-89a7-3b3a1b0a1200 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:07.057915 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-40d89cd4-d8e2-42fd-89a7-3b3a1b0a1200 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:07.058450 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-40d89cd4-d8e2-42fd-89a7-3b3a1b0a1200 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:07.059330 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-40d89cd4-d8e2-42fd-89a7-3b3a1b0a1200 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:07.059843 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-40d89cd4-d8e2-42fd-89a7-3b3a1b0a1200 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:07.229339 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-40d89cd4-d8e2-42fd-89a7-3b3a1b0a1200 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:07.240055 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-40d89cd4-d8e2-42fd-89a7-3b3a1b0a1200 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6" status: 200 len: 1688 microversion: 2.1 time: 0.193018 Jun 03 10:03:07.251672 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 359/754] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:07 2022] GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 => generated 1688 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:07.664681 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-53eed734-e25f-4bcf-90e8-2425f0859d97 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:07.665384 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-53eed734-e25f-4bcf-90e8-2425f0859d97 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:07.672521 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-53eed734-e25f-4bcf-90e8-2425f0859d97 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:07.672972 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-53eed734-e25f-4bcf-90e8-2425f0859d97 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:07.673738 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-53eed734-e25f-4bcf-90e8-2425f0859d97 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:07.674200 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-53eed734-e25f-4bcf-90e8-2425f0859d97 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:07.800355 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-53eed734-e25f-4bcf-90e8-2425f0859d97 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:07.808210 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-53eed734-e25f-4bcf-90e8-2425f0859d97 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:07.809711 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-53eed734-e25f-4bcf-90e8-2425f0859d97 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:07.810842 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-53eed734-e25f-4bcf-90e8-2425f0859d97 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1407 microversion: 2.20 time: 0.150442 Jun 03 10:03:07.811399 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 396/755] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:03:07 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:03:08.258047 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-318c0f1d-171f-41d9-bf4f-a94a01a923ca tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:08.258664 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-318c0f1d-171f-41d9-bf4f-a94a01a923ca tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:08.265656 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-318c0f1d-171f-41d9-bf4f-a94a01a923ca tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:08.266144 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-318c0f1d-171f-41d9-bf4f-a94a01a923ca tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:08.266914 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-318c0f1d-171f-41d9-bf4f-a94a01a923ca tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:08.267357 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-318c0f1d-171f-41d9-bf4f-a94a01a923ca tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:08.407475 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-318c0f1d-171f-41d9-bf4f-a94a01a923ca tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:08.415307 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-318c0f1d-171f-41d9-bf4f-a94a01a923ca tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6" status: 200 len: 1688 microversion: 2.1 time: 0.161340 Jun 03 10:03:08.415870 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 360/756] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:08 2022] GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 => generated 1688 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:08.829002 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-6842bfab-0936-45ad-ab30-bc4969898cb1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:08.829619 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-6842bfab-0936-45ad-ab30-bc4969898cb1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:08.836114 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6842bfab-0936-45ad-ab30-bc4969898cb1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:08.836562 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6842bfab-0936-45ad-ab30-bc4969898cb1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:08.837357 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6842bfab-0936-45ad-ab30-bc4969898cb1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:08.837815 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6842bfab-0936-45ad-ab30-bc4969898cb1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:08.970044 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-6842bfab-0936-45ad-ab30-bc4969898cb1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:08.977894 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-6842bfab-0936-45ad-ab30-bc4969898cb1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:08.979412 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-6842bfab-0936-45ad-ab30-bc4969898cb1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:08.980517 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-6842bfab-0936-45ad-ab30-bc4969898cb1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1407 microversion: 2.20 time: 0.156028 Jun 03 10:03:08.981063 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 397/757] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:03:08 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:03:09.432493 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-d8f8ca76-ea1b-4938-8e88-522845ea6f7c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:09.433075 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-d8f8ca76-ea1b-4938-8e88-522845ea6f7c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:09.440159 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d8f8ca76-ea1b-4938-8e88-522845ea6f7c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:09.440610 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d8f8ca76-ea1b-4938-8e88-522845ea6f7c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:09.441379 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d8f8ca76-ea1b-4938-8e88-522845ea6f7c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:09.441841 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d8f8ca76-ea1b-4938-8e88-522845ea6f7c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:09.566834 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d8f8ca76-ea1b-4938-8e88-522845ea6f7c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:09.574215 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-d8f8ca76-ea1b-4938-8e88-522845ea6f7c tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6" status: 200 len: 1688 microversion: 2.1 time: 0.145580 Jun 03 10:03:09.574774 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 361/758] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:09 2022] GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 => generated 1688 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:09.998575 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-3f323859-d814-4cf8-b985-d5f2339686b7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:09.999338 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-3f323859-d814-4cf8-b985-d5f2339686b7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:10.006266 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3f323859-d814-4cf8-b985-d5f2339686b7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:10.006715 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3f323859-d814-4cf8-b985-d5f2339686b7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:10.007488 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3f323859-d814-4cf8-b985-d5f2339686b7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:10.007925 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3f323859-d814-4cf8-b985-d5f2339686b7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:10.148229 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-3f323859-d814-4cf8-b985-d5f2339686b7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:10.158370 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-3f323859-d814-4cf8-b985-d5f2339686b7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:10.159928 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-3f323859-d814-4cf8-b985-d5f2339686b7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:10.161337 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-3f323859-d814-4cf8-b985-d5f2339686b7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1407 microversion: 2.20 time: 0.166887 Jun 03 10:03:10.162152 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 398/759] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:03:09 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:03:10.423934 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-67e1edaf-50c8-41a6-b0fe-a1e0e6ec529a req-0c81b372-30c6-4f24-bf7b-27f0bb008a3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd6f7d78-98ab-4e91-83cd-fae19bd9bae6", "name": "network-vif-deleted", "tag": "188b0350-b3f9-4bd3-92de-c42a02aaa09f"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:03:10.432436 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-67e1edaf-50c8-41a6-b0fe-a1e0e6ec529a req-0c81b372-30c6-4f24-bf7b-27f0bb008a3c service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:10.432887 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-67e1edaf-50c8-41a6-b0fe-a1e0e6ec529a req-0c81b372-30c6-4f24-bf7b-27f0bb008a3c service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:10.443659 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-67e1edaf-50c8-41a6-b0fe-a1e0e6ec529a req-0c81b372-30c6-4f24-bf7b-27f0bb008a3c service nova] Creating event network-vif-deleted:188b0350-b3f9-4bd3-92de-c42a02aaa09f for instance fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 on hv-cinder-79760 Jun 03 10:03:10.448575 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-67e1edaf-50c8-41a6-b0fe-a1e0e6ec529a req-0c81b372-30c6-4f24-bf7b-27f0bb008a3c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028398 Jun 03 10:03:10.449184 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 362/760] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:03:10.593657 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-1af70b15-4c35-4d1a-a7c8-dc138c6024a1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:10.594345 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-1af70b15-4c35-4d1a-a7c8-dc138c6024a1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:10.609362 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1af70b15-4c35-4d1a-a7c8-dc138c6024a1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:10.611405 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1af70b15-4c35-4d1a-a7c8-dc138c6024a1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:10.614650 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1af70b15-4c35-4d1a-a7c8-dc138c6024a1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:10.615414 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1af70b15-4c35-4d1a-a7c8-dc138c6024a1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:10.689878 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-1af70b15-4c35-4d1a-a7c8-dc138c6024a1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:10.708936 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-1af70b15-4c35-4d1a-a7c8-dc138c6024a1 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6" status: 200 len: 1330 microversion: 2.1 time: 0.121264 Jun 03 10:03:10.713227 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 399/761] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:10 2022] GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 => generated 1330 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:11.180370 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-18e90f17-549e-4147-b679-fc2926a5ec11 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:11.181078 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-18e90f17-549e-4147-b679-fc2926a5ec11 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:11.188144 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-18e90f17-549e-4147-b679-fc2926a5ec11 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:11.188594 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-18e90f17-549e-4147-b679-fc2926a5ec11 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:11.189488 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-18e90f17-549e-4147-b679-fc2926a5ec11 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:11.189819 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-18e90f17-549e-4147-b679-fc2926a5ec11 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:11.338544 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-18e90f17-549e-4147-b679-fc2926a5ec11 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:11.348562 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-18e90f17-549e-4147-b679-fc2926a5ec11 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:11.350093 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-18e90f17-549e-4147-b679-fc2926a5ec11 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:11.351261 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-18e90f17-549e-4147-b679-fc2926a5ec11 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1600 microversion: 2.20 time: 0.175071 Jun 03 10:03:11.351928 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 363/762] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:03:11 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1600 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:03:11.369299 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-d4c5cb83-4b6e-4872-a540-0795d5cef233 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:11.369917 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-d4c5cb83-4b6e-4872-a540-0795d5cef233 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:11.381381 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d4c5cb83-4b6e-4872-a540-0795d5cef233 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:11.381819 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d4c5cb83-4b6e-4872-a540-0795d5cef233 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:11.382799 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d4c5cb83-4b6e-4872-a540-0795d5cef233 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:11.383242 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d4c5cb83-4b6e-4872-a540-0795d5cef233 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:11.465065 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-d4c5cb83-4b6e-4872-a540-0795d5cef233 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.099575 Jun 03 10:03:11.465879 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 400/763] 10.222.0.45 () {60 vars in 1315 bytes} [Fri Jun 3 10:03:11 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 10:03:11.725734 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-4d7c352d-0ed6-4c4b-b9da-14c5e51964eb tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:11.726379 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-4d7c352d-0ed6-4c4b-b9da-14c5e51964eb tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: fd6f7d78-98ab-4e91-83cd-fae19bd9bae6] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:11.732888 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4d7c352d-0ed6-4c4b-b9da-14c5e51964eb tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:11.733344 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4d7c352d-0ed6-4c4b-b9da-14c5e51964eb tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:11.734784 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4d7c352d-0ed6-4c4b-b9da-14c5e51964eb tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:11.735229 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4d7c352d-0ed6-4c4b-b9da-14c5e51964eb tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:11.748758 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.wsgi [None req-4d7c352d-0ed6-4c4b-b9da-14c5e51964eb tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] HTTP exception thrown: Instance fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 could not be found. Jun 03 10:03:11.750593 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-4d7c352d-0ed6-4c4b-b9da-14c5e51964eb tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Request method failure captured: Jun 03 10:03:11.750593 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: request: GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 HTTP/1.1 Jun 03 10:03:11.750593 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept: application/json Jun 03 10:03:11.750593 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept-Encoding: identity Jun 03 10:03:11.750593 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Connection: close Jun 03 10:03:11.750593 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Length: 0 Jun 03 10:03:11.750593 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Type: application/json Jun 03 10:03:11.750593 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Host: 10.222.0.45 Jun 03 10:03:11.750593 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Openstack-System-Scope: None Jun 03 10:03:11.750593 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: User-Agent: python-urllib3/1.26.9 Jun 03 10:03:11.750593 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Auth-Token: gAAAAABimdrfigAOeRL39EQeU8ft5oLHphkLgyvfXeq689r-FPCTJ4y9syXd_Jkm2SUwfkUx56Vaw5Abp0MA7ys2jMe9OzXPF0y6W0tmgHeUN9HmnC9ZvPbEkqx3KEqP4SzVqBlhmk1rpSp0EIzVbucLMiRYAGSLn3O0Lqt3BpdZ6R8sppypbLw Jun 03 10:03:11.750593 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Id: None Jun 03 10:03:11.750593 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Name: None Jun 03 10:03:11.750593 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Identity-Status: Confirmed Jun 03 10:03:11.750593 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Is-Admin-Project: True Jun 03 10:03:11.750593 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Id: default Jun 03 10:03:11.750593 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Name: Default Jun 03 10:03:11.750593 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Id: b96e7e1b09a04adbba3bd083328ecb71 Jun 03 10:03:11.750593 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-631686423 Jun 03 10:03:11.750593 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Role: member,reader Jun 03 10:03:11.750593 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Roles: member,reader Jun 03 10:03:11.752024 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b96e7e1b09a04adbba3bd083328ecb71", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b96e7e1b09a04adbba3bd083328ecb71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b96e7e1b09a04adbba3bd083328ecb71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b96e7e1b09a04adbba3bd083328ecb71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 10:03:11.752024 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant: tempest-ServerRescueNegativeTestJSON-631686423 Jun 03 10:03:11.752024 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Id: b96e7e1b09a04adbba3bd083328ecb71 Jun 03 10:03:11.752024 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-631686423 Jun 03 10:03:11.752024 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User: tempest-ServerRescueNegativeTestJSON-631686423-project Jun 03 10:03:11.752024 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Id: default Jun 03 10:03:11.752024 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Name: Default Jun 03 10:03:11.752024 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Id: d547e64bcf5d4799af6039df3c9a4ea6 Jun 03 10:03:11.752024 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Name: tempest-ServerRescueNegativeTestJSON-631686423-project Jun 03 10:03:11.752024 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: method: > Jun 03 10:03:11.752024 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: exception: Instance fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 could not be found. Jun 03 10:03:11.752024 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: action_args: {'id': 'fd6f7d78-98ab-4e91-83cd-fae19bd9bae6'} Jun 03 10:03:11.752851 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:03:11.752851 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:03:11.752851 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:03:11.752851 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:03:11.752851 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:03:11.752851 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:03:11.752851 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:03:11.752851 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:03:11.752851 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:03:11.752851 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:03:11.752851 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 could not be found. Jun 03 10:03:11.752851 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:03:11.752851 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:03:11.752851 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:03:11.752851 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:03:11.752851 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:03:11.752851 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:03:11.752851 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:03:11.752851 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:03:11.752851 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:03:11.754132 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:03:11.754132 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:03:11.754132 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:03:11.754132 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:03:11.754132 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:03:11.754132 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:03:11.754132 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:03:11.754132 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 could not be found. Jun 03 10:03:11.754132 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:03:11.754132 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:03:11.754132 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:03:11.754132 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:03:11.754132 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:03:11.754132 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:03:11.754132 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:03:11.754132 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:03:11.754132 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 could not be found. Jun 03 10:03:11.754132 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:03:11.755256 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-4d7c352d-0ed6-4c4b-b9da-14c5e51964eb tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Returning 404 to user: Instance fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 could not be found. {{(pid=117648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:03:11.755256 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-4d7c352d-0ed6-4c4b-b9da-14c5e51964eb tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6" status: 404 len: 111 microversion: 2.1 time: 0.030170 Jun 03 10:03:11.755256 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 364/764] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:11 2022] GET /compute/v2.1/servers/fd6f7d78-98ab-4e91-83cd-fae19bd9bae6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 10:03:11.761041 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-8f1a6123-7c95-4786-a7e6-b162b5dc9644 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '.version_select at 0x7f5036b80af0>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:11.778234 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-8f1a6123-7c95-4786-a7e6-b162b5dc9644 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1174271750" status: 202 len: 0 microversion: 2.1 time: 0.021144 Jun 03 10:03:11.778795 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 401/765] 10.222.0.45 () {58 vars in 1220 bytes} [Fri Jun 3 10:03:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1174271750 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 10:03:11.841430 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-48ac3644-1d04-4ee0-b3a4-3da138522653 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:11.842588 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-48ac3644-1d04-4ee0-b3a4-3da138522653 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: ac4d607d-8ff8-4931-b17d-460fda9c0917] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:11.849682 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-48ac3644-1d04-4ee0-b3a4-3da138522653 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:11.850190 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-48ac3644-1d04-4ee0-b3a4-3da138522653 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:11.850910 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-48ac3644-1d04-4ee0-b3a4-3da138522653 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:11.851343 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-48ac3644-1d04-4ee0-b3a4-3da138522653 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:11.878242 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-48ac3644-1d04-4ee0-b3a4-3da138522653 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: ac4d607d-8ff8-4931-b17d-460fda9c0917] Going to try to terminate instance {{(pid=117648) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 10:03:11.929263 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:03:11.958376 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:03:11.963594 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-48ac3644-1d04-4ee0-b3a4-3da138522653 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "DELETE /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917" status: 204 len: 0 microversion: 2.1 time: 0.125724 Jun 03 10:03:11.967169 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 365/766] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jun 3 10:03:11 2022] DELETE /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 10:03:11.972759 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-0f350ef7-1a4d-4fd8-86cd-9c02d242fc73 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:11.973398 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-0f350ef7-1a4d-4fd8-86cd-9c02d242fc73 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: ac4d607d-8ff8-4931-b17d-460fda9c0917] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:11.980950 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0f350ef7-1a4d-4fd8-86cd-9c02d242fc73 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:11.981326 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0f350ef7-1a4d-4fd8-86cd-9c02d242fc73 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:11.982145 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0f350ef7-1a4d-4fd8-86cd-9c02d242fc73 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:11.982582 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0f350ef7-1a4d-4fd8-86cd-9c02d242fc73 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:12.423858 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-0f350ef7-1a4d-4fd8-86cd-9c02d242fc73 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:12.435724 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-0f350ef7-1a4d-4fd8-86cd-9c02d242fc73 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917" status: 200 len: 1576 microversion: 2.1 time: 0.466887 Jun 03 10:03:12.437208 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 402/767] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:11 2022] GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917 => generated 1576 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:12.708760 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-e0d933db-cc64-4f26-81ea-24ef9070f20c req-2f4aeb8d-de34-4063-8214-bac6e121786e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02de8459-bf38-485f-971a-d8f1d7909898", "tag": "5b00cee1-834c-4ff1-b027-9118ca362265"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:03:12.718094 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-e0d933db-cc64-4f26-81ea-24ef9070f20c req-2f4aeb8d-de34-4063-8214-bac6e121786e service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:12.718538 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-e0d933db-cc64-4f26-81ea-24ef9070f20c req-2f4aeb8d-de34-4063-8214-bac6e121786e service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:12.731242 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-e0d933db-cc64-4f26-81ea-24ef9070f20c req-2f4aeb8d-de34-4063-8214-bac6e121786e service nova] Creating event network-changed:5b00cee1-834c-4ff1-b027-9118ca362265 for instance 02de8459-bf38-485f-971a-d8f1d7909898 on hv-cinder-79760 Jun 03 10:03:12.737557 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-e0d933db-cc64-4f26-81ea-24ef9070f20c req-2f4aeb8d-de34-4063-8214-bac6e121786e service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033181 Jun 03 10:03:12.738673 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 366/768] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:03:13.454746 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-bd93da7b-4382-4690-b48e-92cafcd4d841 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:13.455537 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-bd93da7b-4382-4690-b48e-92cafcd4d841 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: ac4d607d-8ff8-4931-b17d-460fda9c0917] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:13.457923 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:03:13.463368 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bd93da7b-4382-4690-b48e-92cafcd4d841 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:13.463828 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bd93da7b-4382-4690-b48e-92cafcd4d841 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:13.464602 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bd93da7b-4382-4690-b48e-92cafcd4d841 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:13.465045 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bd93da7b-4382-4690-b48e-92cafcd4d841 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:13.620367 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-bd93da7b-4382-4690-b48e-92cafcd4d841 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:13.622692 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:03:13.629533 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-bd93da7b-4382-4690-b48e-92cafcd4d841 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917" status: 200 len: 1576 microversion: 2.1 time: 0.179182 Jun 03 10:03:13.630141 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 403/769] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:13 2022] GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917 => generated 1576 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:14.648018 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-3b2532f3-4e04-49da-a3ff-89a1d6866c16 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:14.648759 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-3b2532f3-4e04-49da-a3ff-89a1d6866c16 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: ac4d607d-8ff8-4931-b17d-460fda9c0917] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:14.655043 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3b2532f3-4e04-49da-a3ff-89a1d6866c16 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:14.655498 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3b2532f3-4e04-49da-a3ff-89a1d6866c16 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:14.656274 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3b2532f3-4e04-49da-a3ff-89a1d6866c16 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:14.656714 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3b2532f3-4e04-49da-a3ff-89a1d6866c16 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:14.797260 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-3b2532f3-4e04-49da-a3ff-89a1d6866c16 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:14.804924 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-3b2532f3-4e04-49da-a3ff-89a1d6866c16 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917" status: 200 len: 1576 microversion: 2.1 time: 0.161641 Jun 03 10:03:14.805500 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 367/770] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:14 2022] GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:14.954144 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-61769a77-f5ec-46b1-94ea-fd76438e024e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:14.954747 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-61769a77-f5ec-46b1-94ea-fd76438e024e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:14.961782 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-61769a77-f5ec-46b1-94ea-fd76438e024e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:14.962433 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-61769a77-f5ec-46b1-94ea-fd76438e024e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:14.963356 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-61769a77-f5ec-46b1-94ea-fd76438e024e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:14.963846 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-61769a77-f5ec-46b1-94ea-fd76438e024e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:14.989743 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-61769a77-f5ec-46b1-94ea-fd76438e024e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Going to try to terminate instance {{(pid=117647) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 10:03:15.067361 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-61769a77-f5ec-46b1-94ea-fd76438e024e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "DELETE /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 204 len: 0 microversion: 2.1 time: 0.117408 Jun 03 10:03:15.068920 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 404/771] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jun 3 10:03:14 2022] DELETE /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 10:03:15.078329 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-dfe75b81-7b76-4319-8952-5812dff5ed51 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:15.079075 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-dfe75b81-7b76-4319-8952-5812dff5ed51 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:15.085199 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-dfe75b81-7b76-4319-8952-5812dff5ed51 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:15.085655 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-dfe75b81-7b76-4319-8952-5812dff5ed51 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:15.086471 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-dfe75b81-7b76-4319-8952-5812dff5ed51 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:15.086916 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-dfe75b81-7b76-4319-8952-5812dff5ed51 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:15.225246 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-dfe75b81-7b76-4319-8952-5812dff5ed51 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:15.237386 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-dfe75b81-7b76-4319-8952-5812dff5ed51 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1508 microversion: 2.1 time: 0.164665 Jun 03 10:03:15.238017 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 368/772] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:15 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1508 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:15.481175 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-ffa7553e-02a6-4569-a5b4-9ce081f2ff8f req-342f121c-521f-4260-bb19-82d83b3141c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac4d607d-8ff8-4931-b17d-460fda9c0917", "name": "network-vif-deleted", "tag": "f8af94cb-bdaf-478f-8c87-f417af511b7d"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:03:15.489201 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-ffa7553e-02a6-4569-a5b4-9ce081f2ff8f req-342f121c-521f-4260-bb19-82d83b3141c9 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:15.489647 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-ffa7553e-02a6-4569-a5b4-9ce081f2ff8f req-342f121c-521f-4260-bb19-82d83b3141c9 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:15.501129 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-ffa7553e-02a6-4569-a5b4-9ce081f2ff8f req-342f121c-521f-4260-bb19-82d83b3141c9 service nova] Creating event network-vif-deleted:f8af94cb-bdaf-478f-8c87-f417af511b7d for instance ac4d607d-8ff8-4931-b17d-460fda9c0917 on hv-cinder-79760 Jun 03 10:03:15.506277 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-ffa7553e-02a6-4569-a5b4-9ce081f2ff8f req-342f121c-521f-4260-bb19-82d83b3141c9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029105 Jun 03 10:03:15.506807 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 405/773] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:03:15.822949 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-a652ce9a-f2d8-44be-b12f-3134a9b5857d tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:15.823504 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-a652ce9a-f2d8-44be-b12f-3134a9b5857d tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: ac4d607d-8ff8-4931-b17d-460fda9c0917] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:15.830239 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a652ce9a-f2d8-44be-b12f-3134a9b5857d tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:15.830690 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a652ce9a-f2d8-44be-b12f-3134a9b5857d tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:15.831459 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a652ce9a-f2d8-44be-b12f-3134a9b5857d tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:15.831895 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a652ce9a-f2d8-44be-b12f-3134a9b5857d tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:15.892468 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-a652ce9a-f2d8-44be-b12f-3134a9b5857d tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:15.900002 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-a652ce9a-f2d8-44be-b12f-3134a9b5857d tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917" status: 200 len: 1509 microversion: 2.1 time: 0.081051 Jun 03 10:03:15.900564 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 369/774] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:15 2022] GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917 => generated 1509 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:16.255065 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-8cc2e6d7-8757-42ea-9803-8fdafaa78cbf tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:16.255757 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-8cc2e6d7-8757-42ea-9803-8fdafaa78cbf tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:16.267964 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8cc2e6d7-8757-42ea-9803-8fdafaa78cbf tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:16.268414 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8cc2e6d7-8757-42ea-9803-8fdafaa78cbf tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:16.269202 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8cc2e6d7-8757-42ea-9803-8fdafaa78cbf tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:16.269649 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8cc2e6d7-8757-42ea-9803-8fdafaa78cbf tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:16.417105 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-8cc2e6d7-8757-42ea-9803-8fdafaa78cbf tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:16.425506 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-8cc2e6d7-8757-42ea-9803-8fdafaa78cbf tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1508 microversion: 2.1 time: 0.174793 Jun 03 10:03:16.426126 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 406/775] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:16 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1508 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:16.917088 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-72a0f03c-5725-47b6-a62e-c976c9002218 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:16.918016 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-72a0f03c-5725-47b6-a62e-c976c9002218 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: ac4d607d-8ff8-4931-b17d-460fda9c0917] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:16.925900 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-72a0f03c-5725-47b6-a62e-c976c9002218 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:16.926644 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-72a0f03c-5725-47b6-a62e-c976c9002218 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:16.928004 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-72a0f03c-5725-47b6-a62e-c976c9002218 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:16.928658 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-72a0f03c-5725-47b6-a62e-c976c9002218 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:16.963978 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-72a0f03c-5725-47b6-a62e-c976c9002218 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:16.964429 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-72a0f03c-5725-47b6-a62e-c976c9002218 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:16.964887 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.objects.instance [None req-72a0f03c-5725-47b6-a62e-c976c9002218 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lazy-loading 'fault' on Instance uuid ac4d607d-8ff8-4931-b17d-460fda9c0917 {{(pid=117648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:03:17.008157 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-72a0f03c-5725-47b6-a62e-c976c9002218 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:17.015976 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-72a0f03c-5725-47b6-a62e-c976c9002218 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917" status: 200 len: 1230 microversion: 2.1 time: 0.103188 Jun 03 10:03:17.021624 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 370/776] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:16 2022] GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917 => generated 1230 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:17.442693 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-6bc26f6a-eda4-4a20-9f72-fb959aa0b07e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:17.443341 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-6bc26f6a-eda4-4a20-9f72-fb959aa0b07e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:17.450460 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6bc26f6a-eda4-4a20-9f72-fb959aa0b07e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:17.450870 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6bc26f6a-eda4-4a20-9f72-fb959aa0b07e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:17.451630 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6bc26f6a-eda4-4a20-9f72-fb959aa0b07e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:17.452616 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6bc26f6a-eda4-4a20-9f72-fb959aa0b07e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:17.486659 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6bc26f6a-eda4-4a20-9f72-fb959aa0b07e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:17.487140 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6bc26f6a-eda4-4a20-9f72-fb959aa0b07e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:17.487589 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.objects.instance [None req-6bc26f6a-eda4-4a20-9f72-fb959aa0b07e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lazy-loading 'fault' on Instance uuid 489e83ce-4f5c-4a0c-a3c0-07379977a7b4 {{(pid=117647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:03:17.520414 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-37e13967-0e9c-484c-8f4a-e8a18a7d02bf req-2740902a-c3b8-45ed-a1c2-ad9cb4d51d09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "489e83ce-4f5c-4a0c-a3c0-07379977a7b4", "name": "network-vif-deleted", "tag": "d3dc5ae5-4b40-44f3-b52a-fe25f2c19221"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:03:17.528823 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-37e13967-0e9c-484c-8f4a-e8a18a7d02bf req-2740902a-c3b8-45ed-a1c2-ad9cb4d51d09 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:17.529273 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-37e13967-0e9c-484c-8f4a-e8a18a7d02bf req-2740902a-c3b8-45ed-a1c2-ad9cb4d51d09 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:17.532764 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-6bc26f6a-eda4-4a20-9f72-fb959aa0b07e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:17.541246 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-6bc26f6a-eda4-4a20-9f72-fb959aa0b07e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 200 len: 1312 microversion: 2.1 time: 0.102691 Jun 03 10:03:17.541728 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-37e13967-0e9c-484c-8f4a-e8a18a7d02bf req-2740902a-c3b8-45ed-a1c2-ad9cb4d51d09 service nova] Creating event network-vif-deleted:d3dc5ae5-4b40-44f3-b52a-fe25f2c19221 for instance 489e83ce-4f5c-4a0c-a3c0-07379977a7b4 on hv-cinder-79760 Jun 03 10:03:17.542026 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 407/777] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:17 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 1312 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:17.553853 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-37e13967-0e9c-484c-8f4a-e8a18a7d02bf req-2740902a-c3b8-45ed-a1c2-ad9cb4d51d09 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036978 Jun 03 10:03:17.554779 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 371/778] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:03:18.033617 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-7cbd4342-1573-4518-bca9-e7d50bdbc7a9 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:18.034179 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-7cbd4342-1573-4518-bca9-e7d50bdbc7a9 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: ac4d607d-8ff8-4931-b17d-460fda9c0917] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:18.040717 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7cbd4342-1573-4518-bca9-e7d50bdbc7a9 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:18.041160 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7cbd4342-1573-4518-bca9-e7d50bdbc7a9 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:18.041942 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7cbd4342-1573-4518-bca9-e7d50bdbc7a9 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:18.042377 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7cbd4342-1573-4518-bca9-e7d50bdbc7a9 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:18.057550 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.wsgi [None req-7cbd4342-1573-4518-bca9-e7d50bdbc7a9 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] HTTP exception thrown: Instance ac4d607d-8ff8-4931-b17d-460fda9c0917 could not be found. Jun 03 10:03:18.059199 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-7cbd4342-1573-4518-bca9-e7d50bdbc7a9 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Request method failure captured: Jun 03 10:03:18.059199 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: request: GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917 HTTP/1.1 Jun 03 10:03:18.059199 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Accept: application/json Jun 03 10:03:18.059199 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Accept-Encoding: identity Jun 03 10:03:18.059199 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Connection: close Jun 03 10:03:18.059199 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Content-Length: 0 Jun 03 10:03:18.059199 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Content-Type: application/json Jun 03 10:03:18.059199 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Host: 10.222.0.45 Jun 03 10:03:18.059199 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Openstack-System-Scope: None Jun 03 10:03:18.059199 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: User-Agent: python-urllib3/1.26.9 Jun 03 10:03:18.059199 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Auth-Token: gAAAAABimdtQkRJx_lDKaTLCSgHYIdXBlDDoyslMJ_zPSH-RJq9FS8U8B4Aw4eXzN-IlQda_wzGyCfaxxAE7Bw424ZP6JKCgbz4VJRUs4SHXEFfUK8erLksClDIHuzRQhbNPhsDA5NBUVq-LLAnH9wyEWEwcZE_HmJc4SsF3szinipa_gfm-aoU Jun 03 10:03:18.059199 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Domain-Id: None Jun 03 10:03:18.059199 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Domain-Name: None Jun 03 10:03:18.059199 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Identity-Status: Confirmed Jun 03 10:03:18.059199 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Is-Admin-Project: True Jun 03 10:03:18.059199 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Domain-Id: default Jun 03 10:03:18.059199 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Domain-Name: Default Jun 03 10:03:18.059199 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Id: 8a878ecfb9cd47b684c027beb6ad0b03 Jun 03 10:03:18.059199 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Name: tempest-TestVolumeBootPattern-1979259018 Jun 03 10:03:18.059199 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Role: member,reader Jun 03 10:03:18.059199 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Roles: member,reader Jun 03 10:03:18.060771 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_8a878ecfb9cd47b684c027beb6ad0b03", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/8a878ecfb9cd47b684c027beb6ad0b03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8a878ecfb9cd47b684c027beb6ad0b03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8a878ecfb9cd47b684c027beb6ad0b03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 10:03:18.060771 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant: tempest-TestVolumeBootPattern-1979259018 Jun 03 10:03:18.060771 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant-Id: 8a878ecfb9cd47b684c027beb6ad0b03 Jun 03 10:03:18.060771 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant-Name: tempest-TestVolumeBootPattern-1979259018 Jun 03 10:03:18.060771 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User: tempest-TestVolumeBootPattern-1979259018-project Jun 03 10:03:18.060771 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Domain-Id: default Jun 03 10:03:18.060771 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Domain-Name: Default Jun 03 10:03:18.060771 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Id: 397ff11fedcc4d17867e1d9c10fcd10f Jun 03 10:03:18.060771 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Name: tempest-TestVolumeBootPattern-1979259018-project Jun 03 10:03:18.060771 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: method: > Jun 03 10:03:18.060771 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: exception: Instance ac4d607d-8ff8-4931-b17d-460fda9c0917 could not be found. Jun 03 10:03:18.060771 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: action_args: {'id': 'ac4d607d-8ff8-4931-b17d-460fda9c0917'} Jun 03 10:03:18.061645 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:03:18.061645 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:03:18.061645 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:03:18.061645 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:03:18.061645 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:03:18.061645 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:03:18.061645 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:03:18.061645 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:03:18.061645 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:03:18.061645 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:03:18.061645 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac4d607d-8ff8-4931-b17d-460fda9c0917 could not be found. Jun 03 10:03:18.061645 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:03:18.061645 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:03:18.061645 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:03:18.061645 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:03:18.061645 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:03:18.061645 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:03:18.061645 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:03:18.061645 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:03:18.061645 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:03:18.063154 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:03:18.063154 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:03:18.063154 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:03:18.063154 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:03:18.063154 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:03:18.063154 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:03:18.063154 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:03:18.063154 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac4d607d-8ff8-4931-b17d-460fda9c0917 could not be found. Jun 03 10:03:18.063154 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:03:18.063154 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:03:18.063154 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:03:18.063154 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:03:18.063154 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:03:18.063154 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:03:18.063154 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:03:18.063154 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:03:18.063154 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac4d607d-8ff8-4931-b17d-460fda9c0917 could not be found. Jun 03 10:03:18.063154 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:03:18.064426 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-7cbd4342-1573-4518-bca9-e7d50bdbc7a9 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Returning 404 to user: Instance ac4d607d-8ff8-4931-b17d-460fda9c0917 could not be found. {{(pid=117647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:03:18.064426 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-7cbd4342-1573-4518-bca9-e7d50bdbc7a9 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917" status: 404 len: 111 microversion: 2.1 time: 0.031439 Jun 03 10:03:18.064426 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 408/779] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:18 2022] GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 10:03:18.207808 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-db7c883a-260f-40ac-b3ac-3b73290d0fcd tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1021106532", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1925739570", "security_groups": [{"name": "tempest-secgroup-smoke-995574160"}], "block_device_mapping_v2": [{"uuid": "0809805e-3e72-4d8a-8ba1-c26645686508", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3d3b7b1c-cd6f-47da-b640-3c098fa81e51"}]}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:03:18.317889 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.network.neutron [None req-db7c883a-260f-40ac-b3ac-3b73290d0fcd tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] validate_networks() for [('3d3b7b1c-cd6f-47da-b640-3c098fa81e51', None, None, None, None, None)] {{(pid=117648) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 10:03:18.558584 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-ef09263e-2283-42ef-adc8-ae51dddef96a tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:18.559476 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-ef09263e-2283-42ef-adc8-ae51dddef96a tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 489e83ce-4f5c-4a0c-a3c0-07379977a7b4] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:18.566219 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ef09263e-2283-42ef-adc8-ae51dddef96a tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:18.566722 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ef09263e-2283-42ef-adc8-ae51dddef96a tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:18.567433 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ef09263e-2283-42ef-adc8-ae51dddef96a tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:18.568007 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ef09263e-2283-42ef-adc8-ae51dddef96a tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:18.581318 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.wsgi [None req-ef09263e-2283-42ef-adc8-ae51dddef96a tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] HTTP exception thrown: Instance 489e83ce-4f5c-4a0c-a3c0-07379977a7b4 could not be found. Jun 03 10:03:18.582875 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-ef09263e-2283-42ef-adc8-ae51dddef96a tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Request method failure captured: Jun 03 10:03:18.582875 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: request: GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 HTTP/1.1 Jun 03 10:03:18.582875 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Accept: application/json Jun 03 10:03:18.582875 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Accept-Encoding: identity Jun 03 10:03:18.582875 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Connection: close Jun 03 10:03:18.582875 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Content-Length: 0 Jun 03 10:03:18.582875 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Content-Type: application/json Jun 03 10:03:18.582875 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Host: 10.222.0.45 Jun 03 10:03:18.582875 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Openstack-System-Scope: None Jun 03 10:03:18.582875 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: User-Agent: python-urllib3/1.26.9 Jun 03 10:03:18.582875 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Auth-Token: gAAAAABimdrfigAOeRL39EQeU8ft5oLHphkLgyvfXeq689r-FPCTJ4y9syXd_Jkm2SUwfkUx56Vaw5Abp0MA7ys2jMe9OzXPF0y6W0tmgHeUN9HmnC9ZvPbEkqx3KEqP4SzVqBlhmk1rpSp0EIzVbucLMiRYAGSLn3O0Lqt3BpdZ6R8sppypbLw Jun 03 10:03:18.582875 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Domain-Id: None Jun 03 10:03:18.582875 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Domain-Name: None Jun 03 10:03:18.582875 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Identity-Status: Confirmed Jun 03 10:03:18.582875 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Is-Admin-Project: True Jun 03 10:03:18.582875 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Domain-Id: default Jun 03 10:03:18.582875 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Domain-Name: Default Jun 03 10:03:18.582875 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Id: b96e7e1b09a04adbba3bd083328ecb71 Jun 03 10:03:18.582875 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-631686423 Jun 03 10:03:18.582875 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Role: member,reader Jun 03 10:03:18.582875 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Roles: member,reader Jun 03 10:03:18.584332 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b96e7e1b09a04adbba3bd083328ecb71", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b96e7e1b09a04adbba3bd083328ecb71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b96e7e1b09a04adbba3bd083328ecb71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b96e7e1b09a04adbba3bd083328ecb71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 10:03:18.584332 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant: tempest-ServerRescueNegativeTestJSON-631686423 Jun 03 10:03:18.584332 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant-Id: b96e7e1b09a04adbba3bd083328ecb71 Jun 03 10:03:18.584332 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-631686423 Jun 03 10:03:18.584332 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User: tempest-ServerRescueNegativeTestJSON-631686423-project Jun 03 10:03:18.584332 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Domain-Id: default Jun 03 10:03:18.584332 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Domain-Name: Default Jun 03 10:03:18.584332 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Id: d547e64bcf5d4799af6039df3c9a4ea6 Jun 03 10:03:18.584332 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Name: tempest-ServerRescueNegativeTestJSON-631686423-project Jun 03 10:03:18.584332 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: method: > Jun 03 10:03:18.584332 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: exception: Instance 489e83ce-4f5c-4a0c-a3c0-07379977a7b4 could not be found. Jun 03 10:03:18.584332 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: action_args: {'id': '489e83ce-4f5c-4a0c-a3c0-07379977a7b4'} Jun 03 10:03:18.585096 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:03:18.585096 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:03:18.585096 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:03:18.585096 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:03:18.585096 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:03:18.585096 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:03:18.585096 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:03:18.585096 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:03:18.585096 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:03:18.585096 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:03:18.585096 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 489e83ce-4f5c-4a0c-a3c0-07379977a7b4 could not be found. Jun 03 10:03:18.585096 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:03:18.585096 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:03:18.585096 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:03:18.585096 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:03:18.585096 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:03:18.585096 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:03:18.585096 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:03:18.585096 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:03:18.585096 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:03:18.586428 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:03:18.586428 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:03:18.586428 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:03:18.586428 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:03:18.586428 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:03:18.586428 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:03:18.586428 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:03:18.586428 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 489e83ce-4f5c-4a0c-a3c0-07379977a7b4 could not be found. Jun 03 10:03:18.586428 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:03:18.586428 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:03:18.586428 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:03:18.586428 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:03:18.586428 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:03:18.586428 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:03:18.586428 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:03:18.586428 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:03:18.586428 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 489e83ce-4f5c-4a0c-a3c0-07379977a7b4 could not be found. Jun 03 10:03:18.586428 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:03:18.587711 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-ef09263e-2283-42ef-adc8-ae51dddef96a tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Returning 404 to user: Instance 489e83ce-4f5c-4a0c-a3c0-07379977a7b4 could not be found. {{(pid=117647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:03:18.587711 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-ef09263e-2283-42ef-adc8-ae51dddef96a tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4" status: 404 len: 111 microversion: 2.1 time: 0.029522 Jun 03 10:03:18.587711 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 409/780] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:18 2022] GET /compute/v2.1/servers/489e83ce-4f5c-4a0c-a3c0-07379977a7b4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 03 10:03:18.593197 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-1cea5caa-8803-49cb-adb4-9244f0589a7e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:18.593694 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-1cea5caa-8803-49cb-adb4-9244f0589a7e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 59f3fa08-01f7-45d5-ae2b-171882dbc9c5] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:18.599626 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1cea5caa-8803-49cb-adb4-9244f0589a7e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:18.600306 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1cea5caa-8803-49cb-adb4-9244f0589a7e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:18.602082 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1cea5caa-8803-49cb-adb4-9244f0589a7e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:18.602572 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1cea5caa-8803-49cb-adb4-9244f0589a7e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:18.628408 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-1cea5caa-8803-49cb-adb4-9244f0589a7e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 59f3fa08-01f7-45d5-ae2b-171882dbc9c5] Going to try to terminate instance {{(pid=117647) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 10:03:18.705486 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-1cea5caa-8803-49cb-adb4-9244f0589a7e tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "DELETE /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5" status: 204 len: 0 microversion: 2.1 time: 0.116239 Jun 03 10:03:18.706387 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 410/781] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jun 3 10:03:18 2022] DELETE /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 03 10:03:18.714850 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-20de8e1f-d383-48c3-8a4c-b159e3c1b85a tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:18.715557 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-20de8e1f-d383-48c3-8a4c-b159e3c1b85a tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 59f3fa08-01f7-45d5-ae2b-171882dbc9c5] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:18.722445 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-20de8e1f-d383-48c3-8a4c-b159e3c1b85a tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:18.722910 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-20de8e1f-d383-48c3-8a4c-b159e3c1b85a tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:18.723699 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-20de8e1f-d383-48c3-8a4c-b159e3c1b85a tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:18.724112 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-20de8e1f-d383-48c3-8a4c-b159e3c1b85a tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:18.839052 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-db7c883a-260f-40ac-b3ac-3b73290d0fcd tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Flavor limits 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 10:03:18.839473 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-db7c883a-260f-40ac-b3ac-3b73290d0fcd tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Image limits 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 10:03:18.839967 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-db7c883a-260f-40ac-b3ac-3b73290d0fcd tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Flavor pref 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 10:03:18.840370 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-db7c883a-260f-40ac-b3ac-3b73290d0fcd tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Image pref 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 10:03:18.840776 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-db7c883a-260f-40ac-b3ac-3b73290d0fcd tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 10:03:18.849711 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-db7c883a-260f-40ac-b3ac-3b73290d0fcd tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:18.850192 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-db7c883a-260f-40ac-b3ac-3b73290d0fcd tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:18.851008 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-db7c883a-260f-40ac-b3ac-3b73290d0fcd tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:18.851439 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-db7c883a-260f-40ac-b3ac-3b73290d0fcd tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:18.869379 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-db7c883a-260f-40ac-b3ac-3b73290d0fcd tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Getting quotas for project 8a878ecfb9cd47b684c027beb6ad0b03. Resources: {'ram', 'cores', 'instances'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 10:03:18.873314 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-db7c883a-260f-40ac-b3ac-3b73290d0fcd tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Getting quotas for user 397ff11fedcc4d17867e1d9c10fcd10f and project 8a878ecfb9cd47b684c027beb6ad0b03. Resources: {'ram', 'cores', 'instances'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 10:03:18.883854 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-20de8e1f-d383-48c3-8a4c-b159e3c1b85a tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:18.891850 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-20de8e1f-d383-48c3-8a4c-b159e3c1b85a tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5" status: 200 len: 1520 microversion: 2.1 time: 0.181132 Jun 03 10:03:18.892419 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 411/782] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:18 2022] GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5 => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:03:18.929641 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-db7c883a-260f-40ac-b3ac-3b73290d0fcd tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Going to run 1 instances... {{(pid=117648) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 10:03:18.931828 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-db7c883a-260f-40ac-b3ac-3b73290d0fcd tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: 2aaaa62d-a26a-4cde-8ee5-151fde85889d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0809805e-3e72-4d8a-8ba1-c26645686508',volume_size=None,volume_type=None)] {{(pid=117648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 10:03:19.057273 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-db7c883a-260f-40ac-b3ac-3b73290d0fcd tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.854254 Jun 03 10:03:19.057938 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 372/783] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jun 3 10:03:18 2022] POST /compute/v2.1/servers => generated 405 bytes in 856 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 10:03:19.068423 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-60e0ab9e-f1ba-4470-bb7f-72de1121203c tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:19.069042 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-60e0ab9e-f1ba-4470-bb7f-72de1121203c tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: 2aaaa62d-a26a-4cde-8ee5-151fde85889d] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:19.122730 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-60e0ab9e-f1ba-4470-bb7f-72de1121203c tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:19.130216 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-60e0ab9e-f1ba-4470-bb7f-72de1121203c tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/2aaaa62d-a26a-4cde-8ee5-151fde85889d" status: 200 len: 1095 microversion: 2.1 time: 0.065514 Jun 03 10:03:19.130865 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 412/784] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:19 2022] GET /compute/v2.1/servers/2aaaa62d-a26a-4cde-8ee5-151fde85889d => generated 1095 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:19.908891 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-b259ef51-226a-4565-b5ed-c18aa85cb5a7 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:19.909511 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-b259ef51-226a-4565-b5ed-c18aa85cb5a7 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 59f3fa08-01f7-45d5-ae2b-171882dbc9c5] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:19.916672 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b259ef51-226a-4565-b5ed-c18aa85cb5a7 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:19.917143 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b259ef51-226a-4565-b5ed-c18aa85cb5a7 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:19.917934 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b259ef51-226a-4565-b5ed-c18aa85cb5a7 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:19.918649 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b259ef51-226a-4565-b5ed-c18aa85cb5a7 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:20.047204 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-b259ef51-226a-4565-b5ed-c18aa85cb5a7 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:20.054705 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-b259ef51-226a-4565-b5ed-c18aa85cb5a7 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5" status: 200 len: 1520 microversion: 2.1 time: 0.149823 Jun 03 10:03:20.055273 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 373/785] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:19 2022] GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:20.147431 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-57993beb-7d1f-4a84-9f2f-b4b9d7537341 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:20.147979 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-57993beb-7d1f-4a84-9f2f-b4b9d7537341 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: 2aaaa62d-a26a-4cde-8ee5-151fde85889d] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:20.154197 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-57993beb-7d1f-4a84-9f2f-b4b9d7537341 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:20.154681 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-57993beb-7d1f-4a84-9f2f-b4b9d7537341 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:20.155451 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-57993beb-7d1f-4a84-9f2f-b4b9d7537341 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:20.155938 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-57993beb-7d1f-4a84-9f2f-b4b9d7537341 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:20.216149 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-57993beb-7d1f-4a84-9f2f-b4b9d7537341 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:20.223858 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-57993beb-7d1f-4a84-9f2f-b4b9d7537341 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/2aaaa62d-a26a-4cde-8ee5-151fde85889d" status: 200 len: 1145 microversion: 2.1 time: 0.080496 Jun 03 10:03:20.224418 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 413/786] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:20 2022] GET /compute/v2.1/servers/2aaaa62d-a26a-4cde-8ee5-151fde85889d => generated 1145 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:21.073377 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-02351e05-0e4e-4361-8f59-95f3452e8268 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:21.074028 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-02351e05-0e4e-4361-8f59-95f3452e8268 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 59f3fa08-01f7-45d5-ae2b-171882dbc9c5] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:21.081261 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-02351e05-0e4e-4361-8f59-95f3452e8268 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:21.081708 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-02351e05-0e4e-4361-8f59-95f3452e8268 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:21.082569 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-02351e05-0e4e-4361-8f59-95f3452e8268 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:21.083053 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-02351e05-0e4e-4361-8f59-95f3452e8268 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:21.214748 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-02351e05-0e4e-4361-8f59-95f3452e8268 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:21.222877 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-02351e05-0e4e-4361-8f59-95f3452e8268 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5" status: 200 len: 1520 microversion: 2.1 time: 0.154420 Jun 03 10:03:21.223444 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 374/787] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:21 2022] GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:21.240291 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-ee3d8ec3-9c0e-48ce-b740-1e5c657b0071 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:21.240904 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-ee3d8ec3-9c0e-48ce-b740-1e5c657b0071 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: 2aaaa62d-a26a-4cde-8ee5-151fde85889d] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:21.247660 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ee3d8ec3-9c0e-48ce-b740-1e5c657b0071 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:21.248110 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ee3d8ec3-9c0e-48ce-b740-1e5c657b0071 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:21.248873 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ee3d8ec3-9c0e-48ce-b740-1e5c657b0071 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:21.249309 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ee3d8ec3-9c0e-48ce-b740-1e5c657b0071 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:21.310592 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-ee3d8ec3-9c0e-48ce-b740-1e5c657b0071 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:21.318525 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-ee3d8ec3-9c0e-48ce-b740-1e5c657b0071 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/2aaaa62d-a26a-4cde-8ee5-151fde85889d" status: 200 len: 1137 microversion: 2.1 time: 0.082043 Jun 03 10:03:21.319081 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 414/788] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:21 2022] GET /compute/v2.1/servers/2aaaa62d-a26a-4cde-8ee5-151fde85889d => generated 1137 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:22.239804 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-4e3d797a-6e77-4c96-af09-75d5a9cba8d6 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:22.241279 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-4e3d797a-6e77-4c96-af09-75d5a9cba8d6 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 59f3fa08-01f7-45d5-ae2b-171882dbc9c5] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:22.250293 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4e3d797a-6e77-4c96-af09-75d5a9cba8d6 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:22.251098 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4e3d797a-6e77-4c96-af09-75d5a9cba8d6 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:22.252119 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4e3d797a-6e77-4c96-af09-75d5a9cba8d6 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:22.252869 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4e3d797a-6e77-4c96-af09-75d5a9cba8d6 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:22.336575 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-50bc8aad-d91a-410a-9b3e-42967f498123 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:22.337881 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-50bc8aad-d91a-410a-9b3e-42967f498123 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: 2aaaa62d-a26a-4cde-8ee5-151fde85889d] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:22.344751 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-50bc8aad-d91a-410a-9b3e-42967f498123 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:22.345495 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-50bc8aad-d91a-410a-9b3e-42967f498123 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:22.346480 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-50bc8aad-d91a-410a-9b3e-42967f498123 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:22.347559 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-50bc8aad-d91a-410a-9b3e-42967f498123 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:22.427007 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-50bc8aad-d91a-410a-9b3e-42967f498123 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:22.430526 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-4e3d797a-6e77-4c96-af09-75d5a9cba8d6 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd547e64bcf5d4799af6039df3c9a4ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b96e7e1b09a04adbba3bd083328ecb71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:22.434906 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-50bc8aad-d91a-410a-9b3e-42967f498123 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/2aaaa62d-a26a-4cde-8ee5-151fde85889d" status: 200 len: 1211 microversion: 2.1 time: 0.102550 Jun 03 10:03:22.435478 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 415/789] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:22 2022] GET /compute/v2.1/servers/2aaaa62d-a26a-4cde-8ee5-151fde85889d => generated 1211 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:03:22.454819 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-4e3d797a-6e77-4c96-af09-75d5a9cba8d6 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5" status: 200 len: 1520 microversion: 2.1 time: 0.212674 Jun 03 10:03:22.457309 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 375/790] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:22 2022] GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5 => generated 1520 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:22.541118 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-9fd1c871-990c-4677-a17a-99793c334be1 req-25ebf686-e108-4172-9e04-8b39c131379c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59f3fa08-01f7-45d5-ae2b-171882dbc9c5", "name": "network-vif-deleted", "tag": "fa8981dc-7a31-4c90-a538-73142807983c"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:03:22.550593 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-9fd1c871-990c-4677-a17a-99793c334be1 req-25ebf686-e108-4172-9e04-8b39c131379c service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:22.551135 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-9fd1c871-990c-4677-a17a-99793c334be1 req-25ebf686-e108-4172-9e04-8b39c131379c service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:22.563038 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-9fd1c871-990c-4677-a17a-99793c334be1 req-25ebf686-e108-4172-9e04-8b39c131379c service nova] Creating event network-vif-deleted:fa8981dc-7a31-4c90-a538-73142807983c for instance 59f3fa08-01f7-45d5-ae2b-171882dbc9c5 on hv-cinder-79760 Jun 03 10:03:22.568261 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-9fd1c871-990c-4677-a17a-99793c334be1 req-25ebf686-e108-4172-9e04-8b39c131379c service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030822 Jun 03 10:03:22.568951 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 416/791] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:03:23.453147 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-16d32619-91c0-4782-b2ec-0d55c50aeb8e tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:23.454042 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-16d32619-91c0-4782-b2ec-0d55c50aeb8e tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: 2aaaa62d-a26a-4cde-8ee5-151fde85889d] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:23.460775 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-16d32619-91c0-4782-b2ec-0d55c50aeb8e tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:23.461266 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-16d32619-91c0-4782-b2ec-0d55c50aeb8e tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:23.462170 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-16d32619-91c0-4782-b2ec-0d55c50aeb8e tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:23.462653 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-16d32619-91c0-4782-b2ec-0d55c50aeb8e tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:23.475789 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-9ba7830b-e01b-47b1-9e0f-4699589ee8b8 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:23.476494 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-9ba7830b-e01b-47b1-9e0f-4699589ee8b8 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] [instance: 59f3fa08-01f7-45d5-ae2b-171882dbc9c5] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:23.483728 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9ba7830b-e01b-47b1-9e0f-4699589ee8b8 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:23.484197 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9ba7830b-e01b-47b1-9e0f-4699589ee8b8 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:23.485050 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9ba7830b-e01b-47b1-9e0f-4699589ee8b8 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:23.485492 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9ba7830b-e01b-47b1-9e0f-4699589ee8b8 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:23.509922 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.wsgi [None req-9ba7830b-e01b-47b1-9e0f-4699589ee8b8 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] HTTP exception thrown: Instance 59f3fa08-01f7-45d5-ae2b-171882dbc9c5 could not be found. Jun 03 10:03:23.513712 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-9ba7830b-e01b-47b1-9e0f-4699589ee8b8 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Request method failure captured: Jun 03 10:03:23.513712 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: request: GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5 HTTP/1.1 Jun 03 10:03:23.513712 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Accept: application/json Jun 03 10:03:23.513712 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Accept-Encoding: identity Jun 03 10:03:23.513712 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Connection: close Jun 03 10:03:23.513712 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Content-Length: 0 Jun 03 10:03:23.513712 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Content-Type: application/json Jun 03 10:03:23.513712 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Host: 10.222.0.45 Jun 03 10:03:23.513712 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Openstack-System-Scope: None Jun 03 10:03:23.513712 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: User-Agent: python-urllib3/1.26.9 Jun 03 10:03:23.513712 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Auth-Token: gAAAAABimdrfigAOeRL39EQeU8ft5oLHphkLgyvfXeq689r-FPCTJ4y9syXd_Jkm2SUwfkUx56Vaw5Abp0MA7ys2jMe9OzXPF0y6W0tmgHeUN9HmnC9ZvPbEkqx3KEqP4SzVqBlhmk1rpSp0EIzVbucLMiRYAGSLn3O0Lqt3BpdZ6R8sppypbLw Jun 03 10:03:23.513712 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Domain-Id: None Jun 03 10:03:23.513712 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Domain-Name: None Jun 03 10:03:23.513712 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Identity-Status: Confirmed Jun 03 10:03:23.513712 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Is-Admin-Project: True Jun 03 10:03:23.513712 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Domain-Id: default Jun 03 10:03:23.513712 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Domain-Name: Default Jun 03 10:03:23.513712 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Id: b96e7e1b09a04adbba3bd083328ecb71 Jun 03 10:03:23.513712 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-631686423 Jun 03 10:03:23.513712 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Role: member,reader Jun 03 10:03:23.513712 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Roles: member,reader Jun 03 10:03:23.515449 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_b96e7e1b09a04adbba3bd083328ecb71", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/b96e7e1b09a04adbba3bd083328ecb71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b96e7e1b09a04adbba3bd083328ecb71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/b96e7e1b09a04adbba3bd083328ecb71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 10:03:23.515449 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant: tempest-ServerRescueNegativeTestJSON-631686423 Jun 03 10:03:23.515449 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant-Id: b96e7e1b09a04adbba3bd083328ecb71 Jun 03 10:03:23.515449 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-631686423 Jun 03 10:03:23.515449 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User: tempest-ServerRescueNegativeTestJSON-631686423-project Jun 03 10:03:23.515449 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Domain-Id: default Jun 03 10:03:23.515449 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Domain-Name: Default Jun 03 10:03:23.515449 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Id: d547e64bcf5d4799af6039df3c9a4ea6 Jun 03 10:03:23.515449 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Name: tempest-ServerRescueNegativeTestJSON-631686423-project Jun 03 10:03:23.515449 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: method: > Jun 03 10:03:23.515449 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: exception: Instance 59f3fa08-01f7-45d5-ae2b-171882dbc9c5 could not be found. Jun 03 10:03:23.515449 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: action_args: {'id': '59f3fa08-01f7-45d5-ae2b-171882dbc9c5'} Jun 03 10:03:23.516248 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:03:23.516248 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:03:23.516248 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:03:23.516248 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:03:23.516248 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:03:23.516248 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:03:23.516248 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:03:23.516248 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:03:23.516248 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:03:23.516248 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:03:23.516248 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59f3fa08-01f7-45d5-ae2b-171882dbc9c5 could not be found. Jun 03 10:03:23.516248 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:03:23.516248 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:03:23.516248 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:03:23.516248 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:03:23.516248 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:03:23.516248 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:03:23.516248 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:03:23.516248 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:03:23.516248 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:03:23.517703 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:03:23.517703 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:03:23.517703 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:03:23.517703 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:03:23.517703 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:03:23.517703 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:03:23.517703 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:03:23.517703 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59f3fa08-01f7-45d5-ae2b-171882dbc9c5 could not be found. Jun 03 10:03:23.517703 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:03:23.517703 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:03:23.517703 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:03:23.517703 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:03:23.517703 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:03:23.517703 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:03:23.517703 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:03:23.517703 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:03:23.517703 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59f3fa08-01f7-45d5-ae2b-171882dbc9c5 could not be found. Jun 03 10:03:23.517703 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:03:23.523496 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-9ba7830b-e01b-47b1-9e0f-4699589ee8b8 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] Returning 404 to user: Instance 59f3fa08-01f7-45d5-ae2b-171882dbc9c5 could not be found. {{(pid=117647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:03:23.524651 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-9ba7830b-e01b-47b1-9e0f-4699589ee8b8 tempest-ServerRescueNegativeTestJSON-631686423 tempest-ServerRescueNegativeTestJSON-631686423-project] 10.222.0.45 "GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5" status: 404 len: 111 microversion: 2.1 time: 0.055594 Jun 03 10:03:23.526012 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 417/792] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:23 2022] GET /compute/v2.1/servers/59f3fa08-01f7-45d5-ae2b-171882dbc9c5 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 03 10:03:23.649472 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-16d32619-91c0-4782-b2ec-0d55c50aeb8e tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:23.661448 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-16d32619-91c0-4782-b2ec-0d55c50aeb8e tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/2aaaa62d-a26a-4cde-8ee5-151fde85889d" status: 200 len: 1266 microversion: 2.1 time: 0.212702 Jun 03 10:03:23.673140 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 376/793] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:23 2022] GET /compute/v2.1/servers/2aaaa62d-a26a-4cde-8ee5-151fde85889d => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:24.594402 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-07d23b7a-104b-430f-a6d1-ddefc9bcd140 req-0ece1305-d6ce-4ecf-b02c-04b4c7d9fedf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2aaaa62d-a26a-4cde-8ee5-151fde85889d", "tag": "2990d842-a125-4da9-948a-c2237e5cbd36"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:03:24.602892 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-07d23b7a-104b-430f-a6d1-ddefc9bcd140 req-0ece1305-d6ce-4ecf-b02c-04b4c7d9fedf service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:24.603333 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-07d23b7a-104b-430f-a6d1-ddefc9bcd140 req-0ece1305-d6ce-4ecf-b02c-04b4c7d9fedf service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:24.614762 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-07d23b7a-104b-430f-a6d1-ddefc9bcd140 req-0ece1305-d6ce-4ecf-b02c-04b4c7d9fedf service nova] Creating event network-changed:2990d842-a125-4da9-948a-c2237e5cbd36 for instance 2aaaa62d-a26a-4cde-8ee5-151fde85889d on hv-cinder-79760 Jun 03 10:03:24.626884 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-07d23b7a-104b-430f-a6d1-ddefc9bcd140 req-0ece1305-d6ce-4ecf-b02c-04b4c7d9fedf service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028700 Jun 03 10:03:24.627507 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 418/794] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:03:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:03:24.679528 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-0e7aa350-891b-4a28-aa61-acaca0127da7 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:24.680144 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-0e7aa350-891b-4a28-aa61-acaca0127da7 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: 2aaaa62d-a26a-4cde-8ee5-151fde85889d] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:24.687326 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0e7aa350-891b-4a28-aa61-acaca0127da7 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:24.687775 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0e7aa350-891b-4a28-aa61-acaca0127da7 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:24.688564 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0e7aa350-891b-4a28-aa61-acaca0127da7 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:24.689002 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0e7aa350-891b-4a28-aa61-acaca0127da7 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:24.834369 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-0e7aa350-891b-4a28-aa61-acaca0127da7 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:24.843146 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-0e7aa350-891b-4a28-aa61-acaca0127da7 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/2aaaa62d-a26a-4cde-8ee5-151fde85889d" status: 200 len: 1266 microversion: 2.1 time: 0.167538 Jun 03 10:03:24.844327 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 377/795] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:24 2022] GET /compute/v2.1/servers/2aaaa62d-a26a-4cde-8ee5-151fde85889d => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:25.861283 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-36b569a7-d28c-4908-83e6-4188531a910f tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:25.862026 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-36b569a7-d28c-4908-83e6-4188531a910f tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: 2aaaa62d-a26a-4cde-8ee5-151fde85889d] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:25.868924 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-36b569a7-d28c-4908-83e6-4188531a910f tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:25.869376 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-36b569a7-d28c-4908-83e6-4188531a910f tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:25.870194 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-36b569a7-d28c-4908-83e6-4188531a910f tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:25.870638 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-36b569a7-d28c-4908-83e6-4188531a910f tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:26.013016 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-36b569a7-d28c-4908-83e6-4188531a910f tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:26.020871 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-36b569a7-d28c-4908-83e6-4188531a910f tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/2aaaa62d-a26a-4cde-8ee5-151fde85889d" status: 200 len: 1266 microversion: 2.1 time: 0.164382 Jun 03 10:03:26.030909 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 419/796] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:25 2022] GET /compute/v2.1/servers/2aaaa62d-a26a-4cde-8ee5-151fde85889d => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:27.038362 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-8e10cb50-426f-402d-bb8f-bd48f790a111 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:27.038886 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-8e10cb50-426f-402d-bb8f-bd48f790a111 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: 2aaaa62d-a26a-4cde-8ee5-151fde85889d] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:27.045726 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8e10cb50-426f-402d-bb8f-bd48f790a111 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:27.046198 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8e10cb50-426f-402d-bb8f-bd48f790a111 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:27.046974 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8e10cb50-426f-402d-bb8f-bd48f790a111 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:27.047403 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8e10cb50-426f-402d-bb8f-bd48f790a111 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:27.187633 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-8e10cb50-426f-402d-bb8f-bd48f790a111 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:27.195297 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-8e10cb50-426f-402d-bb8f-bd48f790a111 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/2aaaa62d-a26a-4cde-8ee5-151fde85889d" status: 200 len: 1266 microversion: 2.1 time: 0.161179 Jun 03 10:03:27.195854 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 378/797] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:27 2022] GET /compute/v2.1/servers/2aaaa62d-a26a-4cde-8ee5-151fde85889d => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:28.212427 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-eafc12d5-b273-4247-8ac4-8c801725f38a tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:28.213161 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-eafc12d5-b273-4247-8ac4-8c801725f38a tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: 2aaaa62d-a26a-4cde-8ee5-151fde85889d] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:28.220911 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-eafc12d5-b273-4247-8ac4-8c801725f38a tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:28.221431 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-eafc12d5-b273-4247-8ac4-8c801725f38a tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:28.222296 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-eafc12d5-b273-4247-8ac4-8c801725f38a tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:28.222803 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-eafc12d5-b273-4247-8ac4-8c801725f38a tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:28.356397 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-eafc12d5-b273-4247-8ac4-8c801725f38a tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:28.363854 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-eafc12d5-b273-4247-8ac4-8c801725f38a tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/2aaaa62d-a26a-4cde-8ee5-151fde85889d" status: 200 len: 1266 microversion: 2.1 time: 0.155286 Jun 03 10:03:28.364619 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 420/798] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:28 2022] GET /compute/v2.1/servers/2aaaa62d-a26a-4cde-8ee5-151fde85889d => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:28.862219 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell0:SELECT=2 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:03:28.880484 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell0:SELECT=6 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:03:28.960824 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-152f585a-78aa-44dd-870f-3685a9895f3a tempest-VolumesGetTestJSON-1574261135 tempest-VolumesGetTestJSON-1574261135-project] Action: 'create', calling method: .version_select at 0x7f5036bd1670>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-431942580", "metadata": {"Type": "work"}}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:03:29.240426 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-152f585a-78aa-44dd-870f-3685a9895f3a tempest-VolumesGetTestJSON-1574261135 tempest-VolumesGetTestJSON-1574261135-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.395035 Jun 03 10:03:29.241049 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 379/799] 10.222.0.45 () {60 vars in 1155 bytes} [Fri Jun 3 10:03:28 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 396 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 03 10:03:29.252135 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-c3c41c9e-20c8-4297-b40f-71a85b251dc7 tempest-VolumesGetTestJSON-1574261135 tempest-VolumesGetTestJSON-1574261135-project] Calling method '.version_select at 0x7f5036d77f70>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:29.258696 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell0:SELECT=2 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:03:29.303875 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-c3c41c9e-20c8-4297-b40f-71a85b251dc7 tempest-VolumesGetTestJSON-1574261135 tempest-VolumesGetTestJSON-1574261135-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/ca932939-5a74-4993-b8b0-b48ba7ca6fc2" status: 200 len: 352 microversion: 2.1 time: 0.055984 Jun 03 10:03:29.304444 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 421/800] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Jun 3 10:03:29 2022] GET /compute/v2.1/os-volumes/ca932939-5a74-4993-b8b0-b48ba7ca6fc2 => generated 352 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:03:29.381310 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-40110123-a100-41cf-93cc-e4b1894f490b tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:29.382030 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-40110123-a100-41cf-93cc-e4b1894f490b tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: 2aaaa62d-a26a-4cde-8ee5-151fde85889d] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:29.389349 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-40110123-a100-41cf-93cc-e4b1894f490b tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:29.389823 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-40110123-a100-41cf-93cc-e4b1894f490b tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:29.390594 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-40110123-a100-41cf-93cc-e4b1894f490b tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:29.391023 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-40110123-a100-41cf-93cc-e4b1894f490b tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:29.517443 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-40110123-a100-41cf-93cc-e4b1894f490b tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:29.524782 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-40110123-a100-41cf-93cc-e4b1894f490b tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/2aaaa62d-a26a-4cde-8ee5-151fde85889d" status: 200 len: 1266 microversion: 2.1 time: 0.148038 Jun 03 10:03:29.525362 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 380/801] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:29 2022] GET /compute/v2.1/servers/2aaaa62d-a26a-4cde-8ee5-151fde85889d => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:30.316854 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-5f199d2c-fbc0-4d84-aa3a-9799b4c45666 tempest-VolumesGetTestJSON-1574261135 tempest-VolumesGetTestJSON-1574261135-project] Calling method '.version_select at 0x7f5036ad3c10>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:30.363337 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-5f199d2c-fbc0-4d84-aa3a-9799b4c45666 tempest-VolumesGetTestJSON-1574261135 tempest-VolumesGetTestJSON-1574261135-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/ca932939-5a74-4993-b8b0-b48ba7ca6fc2" status: 200 len: 353 microversion: 2.1 time: 0.050833 Jun 03 10:03:30.363893 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 422/802] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Jun 3 10:03:30 2022] GET /compute/v2.1/os-volumes/ca932939-5a74-4993-b8b0-b48ba7ca6fc2 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:03:30.374610 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-1a80dd6d-949a-4721-a2d2-38f3666a191b tempest-VolumesGetTestJSON-1574261135 tempest-VolumesGetTestJSON-1574261135-project] Calling method '.version_select at 0x7f5036ba65e0>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:30.421252 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-1a80dd6d-949a-4721-a2d2-38f3666a191b tempest-VolumesGetTestJSON-1574261135 tempest-VolumesGetTestJSON-1574261135-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/ca932939-5a74-4993-b8b0-b48ba7ca6fc2" status: 200 len: 353 microversion: 2.1 time: 0.049660 Jun 03 10:03:30.421865 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 381/803] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Jun 3 10:03:30 2022] GET /compute/v2.1/os-volumes/ca932939-5a74-4993-b8b0-b48ba7ca6fc2 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:03:30.433007 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-a4795bb5-dd89-4b60-aacc-2bf1a29c1667 tempest-VolumesGetTestJSON-1574261135 tempest-VolumesGetTestJSON-1574261135-project] Calling method '.version_select at 0x7f5036d601f0>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:30.493407 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-a4795bb5-dd89-4b60-aacc-2bf1a29c1667 tempest-VolumesGetTestJSON-1574261135 tempest-VolumesGetTestJSON-1574261135-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/ca932939-5a74-4993-b8b0-b48ba7ca6fc2" status: 202 len: 0 microversion: 2.1 time: 0.063992 Jun 03 10:03:30.494009 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 423/804] 10.222.0.45 () {58 vars in 1247 bytes} [Fri Jun 3 10:03:30 2022] DELETE /compute/v2.1/os-volumes/ca932939-5a74-4993-b8b0-b48ba7ca6fc2 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 03 10:03:30.502256 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-f7b732cc-0299-4495-bdca-be092e1ef958 tempest-VolumesGetTestJSON-1574261135 tempest-VolumesGetTestJSON-1574261135-project] Calling method '.version_select at 0x7f5036c10430>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:30.541979 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-faebbdaa-42f8-467a-9bfd-2f0092feedb5 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:30.542624 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-faebbdaa-42f8-467a-9bfd-2f0092feedb5 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: 2aaaa62d-a26a-4cde-8ee5-151fde85889d] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:30.549447 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-faebbdaa-42f8-467a-9bfd-2f0092feedb5 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:30.549926 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-faebbdaa-42f8-467a-9bfd-2f0092feedb5 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:30.550724 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-faebbdaa-42f8-467a-9bfd-2f0092feedb5 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:30.551127 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-faebbdaa-42f8-467a-9bfd-2f0092feedb5 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:30.554033 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-f7b732cc-0299-4495-bdca-be092e1ef958 tempest-VolumesGetTestJSON-1574261135 tempest-VolumesGetTestJSON-1574261135-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/ca932939-5a74-4993-b8b0-b48ba7ca6fc2" status: 200 len: 352 microversion: 2.1 time: 0.055536 Jun 03 10:03:30.554642 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 382/805] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Jun 3 10:03:30 2022] GET /compute/v2.1/os-volumes/ca932939-5a74-4993-b8b0-b48ba7ca6fc2 => generated 352 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 10:03:30.683440 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-faebbdaa-42f8-467a-9bfd-2f0092feedb5 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:30.685773 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:03:30.692556 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-faebbdaa-42f8-467a-9bfd-2f0092feedb5 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/2aaaa62d-a26a-4cde-8ee5-151fde85889d" status: 200 len: 1266 microversion: 2.1 time: 0.154436 Jun 03 10:03:30.693139 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 424/806] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:30 2022] GET /compute/v2.1/servers/2aaaa62d-a26a-4cde-8ee5-151fde85889d => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:31.479117 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-64a7c076-3e9a-47be-b92a-78b8498107c7 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:31.479610 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-64a7c076-3e9a-47be-b92a-78b8498107c7 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: b85ca18b-9b76-43c9-af4d-d7bf77231976] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:31.486329 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-64a7c076-3e9a-47be-b92a-78b8498107c7 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:31.486771 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-64a7c076-3e9a-47be-b92a-78b8498107c7 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:31.487535 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-64a7c076-3e9a-47be-b92a-78b8498107c7 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:31.487987 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-64a7c076-3e9a-47be-b92a-78b8498107c7 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:31.509620 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-64a7c076-3e9a-47be-b92a-78b8498107c7 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/b85ca18b-9b76-43c9-af4d-d7bf77231976/ips" status: 200 len: 150 microversion: 2.1 time: 0.034909 Jun 03 10:03:31.510192 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 383/807] 10.222.0.45 () {58 vars in 1247 bytes} [Fri Jun 3 10:03:31 2022] GET /compute/v2.1/servers/b85ca18b-9b76-43c9-af4d-d7bf77231976/ips => generated 150 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:03:31.566650 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-22f1c79f-55a1-4574-b11c-9b7cafe68c21 tempest-VolumesGetTestJSON-1574261135 tempest-VolumesGetTestJSON-1574261135-project] Calling method '.version_select at 0x7f50377fed30>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:31.598491 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.wsgi [None req-22f1c79f-55a1-4574-b11c-9b7cafe68c21 tempest-VolumesGetTestJSON-1574261135 tempest-VolumesGetTestJSON-1574261135-project] HTTP exception thrown: Volume ca932939-5a74-4993-b8b0-b48ba7ca6fc2 could not be found. Jun 03 10:03:31.601484 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-22f1c79f-55a1-4574-b11c-9b7cafe68c21 tempest-VolumesGetTestJSON-1574261135 tempest-VolumesGetTestJSON-1574261135-project] Request method failure captured: Jun 03 10:03:31.601484 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: request: GET /compute/v2.1/os-volumes/ca932939-5a74-4993-b8b0-b48ba7ca6fc2 HTTP/1.1 Jun 03 10:03:31.601484 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Accept: application/json Jun 03 10:03:31.601484 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Accept-Encoding: identity Jun 03 10:03:31.601484 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Connection: close Jun 03 10:03:31.601484 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Content-Length: 0 Jun 03 10:03:31.601484 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Content-Type: application/json Jun 03 10:03:31.601484 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Host: 10.222.0.45 Jun 03 10:03:31.601484 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Openstack-System-Scope: None Jun 03 10:03:31.601484 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: User-Agent: python-urllib3/1.26.9 Jun 03 10:03:31.601484 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Auth-Token: gAAAAABimdxwbqO1AtHUImhjMhaxe4pe8x7x_ZoSt2pI77ft6uy_BkolvJVzqnQxNFLryIY7UsJ4en6hXt8mhpY5MohxT8v4u7ZpPgC6iCInu5fPePoUKb38-6BS_pGnfjU1-rZgAF5hRozNfSWLD6oaE8qiCjnlOvLkTZ7tmAcOpMmUXNStJFQ Jun 03 10:03:31.601484 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Domain-Id: None Jun 03 10:03:31.601484 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Domain-Name: None Jun 03 10:03:31.601484 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Identity-Status: Confirmed Jun 03 10:03:31.601484 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Is-Admin-Project: True Jun 03 10:03:31.601484 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Domain-Id: default Jun 03 10:03:31.601484 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Domain-Name: Default Jun 03 10:03:31.601484 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Id: d3084b4587c9445bb98f05ef495949a5 Jun 03 10:03:31.601484 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Name: tempest-VolumesGetTestJSON-1574261135 Jun 03 10:03:31.601484 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Role: member,reader Jun 03 10:03:31.601484 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Roles: member,reader Jun 03 10:03:31.604087 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_d3084b4587c9445bb98f05ef495949a5", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/d3084b4587c9445bb98f05ef495949a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d3084b4587c9445bb98f05ef495949a5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/d3084b4587c9445bb98f05ef495949a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 10:03:31.604087 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant: tempest-VolumesGetTestJSON-1574261135 Jun 03 10:03:31.604087 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant-Id: d3084b4587c9445bb98f05ef495949a5 Jun 03 10:03:31.604087 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant-Name: tempest-VolumesGetTestJSON-1574261135 Jun 03 10:03:31.604087 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User: tempest-VolumesGetTestJSON-1574261135-project Jun 03 10:03:31.604087 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Domain-Id: default Jun 03 10:03:31.604087 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Domain-Name: Default Jun 03 10:03:31.604087 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Id: af4bf91aafc644a2b27ae943507dfd54 Jun 03 10:03:31.604087 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Name: tempest-VolumesGetTestJSON-1574261135-project Jun 03 10:03:31.604087 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: method: Jun 03 10:03:31.604087 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: exception: Volume ca932939-5a74-4993-b8b0-b48ba7ca6fc2 could not be found. Jun 03 10:03:31.604087 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: action_args: {'id': 'ca932939-5a74-4993-b8b0-b48ba7ca6fc2'} Jun 03 10:03:31.604087 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:03:31.605828 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:03:31.605828 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 10:03:31.605828 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 10:03:31.605828 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 10:03:31.605828 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 10:03:31.605828 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 10:03:31.605828 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 10:03:31.605828 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 10:03:31.605828 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 10:03:31.605828 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 10:03:31.605828 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 10:03:31.605828 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 10:03:31.605828 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 10:03:31.605828 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 10:03:31.605828 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 10:03:31.605828 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ca932939-5a74-4993-b8b0-b48ba7ca6fc2 could not be found. (HTTP 404) (Request-ID: req-61c0e0fe-bdc5-4334-9a98-fa3dafbf18cf) Jun 03 10:03:31.605828 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:03:31.605828 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:03:31.605828 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:03:31.608055 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:03:31.608055 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 03 10:03:31.608055 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 03 10:03:31.608055 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 10:03:31.608055 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 10:03:31.608055 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 03 10:03:31.608055 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 03 10:03:31.608055 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 10:03:31.608055 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 10:03:31.608055 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 10:03:31.608055 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 10:03:31.608055 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 10:03:31.608055 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 10:03:31.608055 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 10:03:31.608055 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 10:03:31.608055 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 10:03:31.608055 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 10:03:31.608055 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 10:03:31.608055 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 10:03:31.609810 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 10:03:31.609810 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 10:03:31.609810 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 10:03:31.609810 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 10:03:31.609810 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ca932939-5a74-4993-b8b0-b48ba7ca6fc2 could not be found. Jun 03 10:03:31.609810 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:03:31.609810 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:03:31.609810 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:03:31.609810 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:03:31.609810 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:03:31.609810 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:03:31.609810 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:03:31.609810 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:03:31.609810 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 10:03:31.609810 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 10:03:31.609810 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:03:31.609810 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:03:31.609810 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 03 10:03:31.609810 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:03:31.611225 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ca932939-5a74-4993-b8b0-b48ba7ca6fc2 could not be found. Jun 03 10:03:31.611225 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:03:31.611225 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:03:31.611225 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:03:31.611225 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:03:31.611225 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:03:31.611225 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:03:31.611225 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:03:31.611225 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:03:31.611225 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ca932939-5a74-4993-b8b0-b48ba7ca6fc2 could not be found. Jun 03 10:03:31.611225 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:03:31.611225 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-22f1c79f-55a1-4574-b11c-9b7cafe68c21 tempest-VolumesGetTestJSON-1574261135 tempest-VolumesGetTestJSON-1574261135-project] Returning 404 to user: Volume ca932939-5a74-4993-b8b0-b48ba7ca6fc2 could not be found. {{(pid=117647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:03:31.611225 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-22f1c79f-55a1-4574-b11c-9b7cafe68c21 tempest-VolumesGetTestJSON-1574261135 tempest-VolumesGetTestJSON-1574261135-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/ca932939-5a74-4993-b8b0-b48ba7ca6fc2" status: 404 len: 109 microversion: 2.1 time: 0.040453 Jun 03 10:03:31.611225 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 425/808] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Jun 3 10:03:31 2022] GET /compute/v2.1/os-volumes/ca932939-5a74-4993-b8b0-b48ba7ca6fc2 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 10:03:31.709318 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-1152e981-8fe9-4291-adf7-962668b1787a tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:31.709981 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-1152e981-8fe9-4291-adf7-962668b1787a tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: 2aaaa62d-a26a-4cde-8ee5-151fde85889d] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:31.716892 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1152e981-8fe9-4291-adf7-962668b1787a tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:31.717461 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1152e981-8fe9-4291-adf7-962668b1787a tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:31.719088 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1152e981-8fe9-4291-adf7-962668b1787a tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:31.719571 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1152e981-8fe9-4291-adf7-962668b1787a tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:31.905117 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-1152e981-8fe9-4291-adf7-962668b1787a tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:31.915388 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-1152e981-8fe9-4291-adf7-962668b1787a tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/2aaaa62d-a26a-4cde-8ee5-151fde85889d" status: 200 len: 1266 microversion: 2.1 time: 0.209476 Jun 03 10:03:31.916349 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 384/809] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:31 2022] GET /compute/v2.1/servers/2aaaa62d-a26a-4cde-8ee5-151fde85889d => generated 1266 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:32.868181 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-a3ed96c1-081a-4d4f-a6aa-0ff49622d7c1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "96c08eab-0f3b-4f71-9d6d-cb780b3efd01"}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:03:32.869254 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-a3ed96c1-081a-4d4f-a6aa-0ff49622d7c1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: b85ca18b-9b76-43c9-af4d-d7bf77231976] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:32.875932 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a3ed96c1-081a-4d4f-a6aa-0ff49622d7c1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:32.876386 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a3ed96c1-081a-4d4f-a6aa-0ff49622d7c1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:32.877159 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a3ed96c1-081a-4d4f-a6aa-0ff49622d7c1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:32.877601 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a3ed96c1-081a-4d4f-a6aa-0ff49622d7c1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:32.937369 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-2315e165-8adc-4f99-a9b9-43242458bd33 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:32.938015 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-2315e165-8adc-4f99-a9b9-43242458bd33 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: 2aaaa62d-a26a-4cde-8ee5-151fde85889d] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:32.944466 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2315e165-8adc-4f99-a9b9-43242458bd33 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:32.944922 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2315e165-8adc-4f99-a9b9-43242458bd33 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:32.945691 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2315e165-8adc-4f99-a9b9-43242458bd33 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:32.946162 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2315e165-8adc-4f99-a9b9-43242458bd33 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:33.082651 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-2315e165-8adc-4f99-a9b9-43242458bd33 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:33.090833 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-2315e165-8adc-4f99-a9b9-43242458bd33 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/2aaaa62d-a26a-4cde-8ee5-151fde85889d" status: 200 len: 1266 microversion: 2.1 time: 0.162591 Jun 03 10:03:33.091833 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 385/810] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:32 2022] GET /compute/v2.1/servers/2aaaa62d-a26a-4cde-8ee5-151fde85889d => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:03:33.151618 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-a3ed96c1-081a-4d4f-a6aa-0ff49622d7c1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "POST /compute/v2.1/servers/b85ca18b-9b76-43c9-af4d-d7bf77231976/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288266 Jun 03 10:03:33.152264 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 426/811] 10.222.0.45 () {60 vars in 1322 bytes} [Fri Jun 3 10:03:32 2022] POST /compute/v2.1/servers/b85ca18b-9b76-43c9-af4d-d7bf77231976/os-volume_attachments => generated 194 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 10:03:33.229162 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-1305daa3-bf2e-49bd-99c7-da12d45ea5c5 tempest-VolumesNegativeTest-1386442642 tempest-VolumesNegativeTest-1386442642-project] Action: 'create', calling method: .version_select at 0x7f5036b938b0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1630608449", "metadata": {"Type": "work"}}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:03:33.243012 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-1305daa3-bf2e-49bd-99c7-da12d45ea5c5 tempest-VolumesNegativeTest-1386442642 tempest-VolumesNegativeTest-1386442642-project] Request method failure captured: Jun 03 10:03:33.243012 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 03 10:03:33.243012 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept: application/json Jun 03 10:03:33.243012 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept-Encoding: identity Jun 03 10:03:33.243012 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Connection: close Jun 03 10:03:33.243012 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Length: 122 Jun 03 10:03:33.243012 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Type: application/json Jun 03 10:03:33.243012 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Host: 10.222.0.45 Jun 03 10:03:33.243012 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Openstack-System-Scope: None Jun 03 10:03:33.243012 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: User-Agent: python-urllib3/1.26.9 Jun 03 10:03:33.243012 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Auth-Token: gAAAAABimdx05pQXeqXfFTZh9iegmKzAJ-UbLx96h9C1MrArT81sWfPh1TDAy63RjOxQklzhgWcmFjfCMzjpyDqGOPI34yhxc-xTihIueTzjKMt_qlXhktI2NiZfjcxTsUcO0SDpwm9OsLshnLAdlxCVV-5CsfQj5fqvfQWmO_Vd05fcNf2MJUg Jun 03 10:03:33.243012 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Id: None Jun 03 10:03:33.243012 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Name: None Jun 03 10:03:33.243012 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Identity-Status: Confirmed Jun 03 10:03:33.243012 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Is-Admin-Project: True Jun 03 10:03:33.243012 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Id: default Jun 03 10:03:33.243012 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Name: Default Jun 03 10:03:33.243012 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Id: c7abb0ba7999459d9a200eeb1c17f505 Jun 03 10:03:33.243012 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Name: tempest-VolumesNegativeTest-1386442642 Jun 03 10:03:33.243012 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Role: member,reader Jun 03 10:03:33.243012 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Roles: member,reader Jun 03 10:03:33.244359 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c7abb0ba7999459d9a200eeb1c17f505", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c7abb0ba7999459d9a200eeb1c17f505"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c7abb0ba7999459d9a200eeb1c17f505"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c7abb0ba7999459d9a200eeb1c17f505"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 10:03:33.244359 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant: tempest-VolumesNegativeTest-1386442642 Jun 03 10:03:33.244359 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Id: c7abb0ba7999459d9a200eeb1c17f505 Jun 03 10:03:33.244359 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Name: tempest-VolumesNegativeTest-1386442642 Jun 03 10:03:33.244359 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User: tempest-VolumesNegativeTest-1386442642-project Jun 03 10:03:33.244359 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Id: default Jun 03 10:03:33.244359 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Name: Default Jun 03 10:03:33.244359 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Id: 3aad8a223c79474a83cd42410f7b4d12 Jun 03 10:03:33.244359 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Name: tempest-VolumesNegativeTest-1386442642-project Jun 03 10:03:33.244359 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Jun 03 10:03:33.244359 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1630608449", "metadata": {"Type": "work"}}} Jun 03 10:03:33.244359 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: method: Jun 03 10:03:33.244359 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 03 10:03:33.245166 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1630608449', 'metadata': {'Type': 'work'}}}} Jun 03 10:03:33.245166 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:03:33.245166 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:03:33.245166 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 03 10:03:33.245166 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 03 10:03:33.245166 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 03 10:03:33.245166 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise error Jun 03 10:03:33.245166 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 03 10:03:33.245166 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:03:33.245166 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 03 10:03:33.245166 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 03 10:03:33.245166 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:03:33.245166 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 03 10:03:33.245166 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi '#$%' Jun 03 10:03:33.245166 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:03:33.245166 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:03:33.245166 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:03:33.245166 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:03:33.245166 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:03:33.245166 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:03:33.245166 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:03:33.245166 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:03:33.246725 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 10:03:33.246725 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 10:03:33.246725 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:03:33.246725 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:03:33.246725 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 03 10:03:33.246725 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 03 10:03:33.246725 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 03 10:03:33.246725 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 03 10:03:33.246725 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 03 10:03:33.246725 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 03 10:03:33.246725 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 03 10:03:33.246725 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:03:33.246725 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:03:33.246725 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:03:33.246725 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:03:33.246725 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:03:33.246725 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:03:33.246725 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 03 10:03:33.246725 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 03 10:03:33.248134 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 03 10:03:33.248134 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:03:33.248134 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-1305daa3-bf2e-49bd-99c7-da12d45ea5c5 tempest-VolumesNegativeTest-1386442642 tempest-VolumesNegativeTest-1386442642-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:03:33.248134 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-1305daa3-bf2e-49bd-99c7-da12d45ea5c5 tempest-VolumesNegativeTest-1386442642 tempest-VolumesNegativeTest-1386442642-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.151103 Jun 03 10:03:33.248134 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 386/812] 10.222.0.45 () {60 vars in 1155 bytes} [Fri Jun 3 10:03:33 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 153 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 03 10:03:33.255392 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-39483d81-9a75-4768-a679-96cbf329ad23 tempest-VolumesNegativeTest-1386442642 tempest-VolumesNegativeTest-1386442642-project] Action: 'create', calling method: .version_select at 0x7f5036a0ce50>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-587528346", "metadata": {"Type": "work"}}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:03:33.258909 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-39483d81-9a75-4768-a679-96cbf329ad23 tempest-VolumesNegativeTest-1386442642 tempest-VolumesNegativeTest-1386442642-project] Request method failure captured: Jun 03 10:03:33.258909 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 03 10:03:33.258909 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Accept: application/json Jun 03 10:03:33.258909 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Accept-Encoding: identity Jun 03 10:03:33.258909 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Connection: close Jun 03 10:03:33.258909 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Content-Length: 119 Jun 03 10:03:33.258909 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Content-Type: application/json Jun 03 10:03:33.258909 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Host: 10.222.0.45 Jun 03 10:03:33.258909 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Openstack-System-Scope: None Jun 03 10:03:33.258909 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: User-Agent: python-urllib3/1.26.9 Jun 03 10:03:33.258909 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Auth-Token: gAAAAABimdx05pQXeqXfFTZh9iegmKzAJ-UbLx96h9C1MrArT81sWfPh1TDAy63RjOxQklzhgWcmFjfCMzjpyDqGOPI34yhxc-xTihIueTzjKMt_qlXhktI2NiZfjcxTsUcO0SDpwm9OsLshnLAdlxCVV-5CsfQj5fqvfQWmO_Vd05fcNf2MJUg Jun 03 10:03:33.258909 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Domain-Id: None Jun 03 10:03:33.258909 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Domain-Name: None Jun 03 10:03:33.258909 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Identity-Status: Confirmed Jun 03 10:03:33.258909 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Is-Admin-Project: True Jun 03 10:03:33.258909 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Domain-Id: default Jun 03 10:03:33.258909 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Domain-Name: Default Jun 03 10:03:33.258909 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Id: c7abb0ba7999459d9a200eeb1c17f505 Jun 03 10:03:33.258909 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Name: tempest-VolumesNegativeTest-1386442642 Jun 03 10:03:33.258909 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Role: member,reader Jun 03 10:03:33.258909 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Roles: member,reader Jun 03 10:03:33.260470 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c7abb0ba7999459d9a200eeb1c17f505", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c7abb0ba7999459d9a200eeb1c17f505"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c7abb0ba7999459d9a200eeb1c17f505"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c7abb0ba7999459d9a200eeb1c17f505"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 10:03:33.260470 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant: tempest-VolumesNegativeTest-1386442642 Jun 03 10:03:33.260470 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant-Id: c7abb0ba7999459d9a200eeb1c17f505 Jun 03 10:03:33.260470 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant-Name: tempest-VolumesNegativeTest-1386442642 Jun 03 10:03:33.260470 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User: tempest-VolumesNegativeTest-1386442642-project Jun 03 10:03:33.260470 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Domain-Id: default Jun 03 10:03:33.260470 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Domain-Name: Default Jun 03 10:03:33.260470 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Id: 3aad8a223c79474a83cd42410f7b4d12 Jun 03 10:03:33.260470 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Name: tempest-VolumesNegativeTest-1386442642-project Jun 03 10:03:33.260470 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Jun 03 10:03:33.260470 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-587528346", "metadata": {"Type": "work"}}} Jun 03 10:03:33.260470 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: method: Jun 03 10:03:33.260470 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 03 10:03:33.261594 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-587528346', 'metadata': {'Type': 'work'}}}} Jun 03 10:03:33.261594 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:03:33.261594 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:03:33.261594 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 03 10:03:33.261594 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 03 10:03:33.261594 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 03 10:03:33.261594 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise error Jun 03 10:03:33.261594 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 03 10:03:33.261594 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:03:33.261594 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 03 10:03:33.261594 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 03 10:03:33.261594 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:03:33.261594 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 03 10:03:33.261594 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi '0' Jun 03 10:03:33.261594 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:03:33.261594 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:03:33.261594 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:03:33.261594 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:03:33.261594 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:03:33.261594 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:03:33.261594 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:03:33.261594 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:03:33.262960 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 10:03:33.262960 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 10:03:33.262960 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:03:33.262960 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:03:33.262960 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 03 10:03:33.262960 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 03 10:03:33.262960 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 03 10:03:33.262960 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 03 10:03:33.262960 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 03 10:03:33.262960 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 03 10:03:33.262960 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 03 10:03:33.262960 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:03:33.262960 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:03:33.262960 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:03:33.262960 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:03:33.262960 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:03:33.262960 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:03:33.262960 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 03 10:03:33.262960 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 03 10:03:33.264078 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 03 10:03:33.264078 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:03:33.264078 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-39483d81-9a75-4768-a679-96cbf329ad23 tempest-VolumesNegativeTest-1386442642 tempest-VolumesNegativeTest-1386442642-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:03:33.264078 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-39483d81-9a75-4768-a679-96cbf329ad23 tempest-VolumesNegativeTest-1386442642 tempest-VolumesNegativeTest-1386442642-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009584 Jun 03 10:03:33.264078 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 427/813] 10.222.0.45 () {60 vars in 1155 bytes} [Fri Jun 3 10:03:33 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 03 10:03:33.270100 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-da009637-faf8-4aaf-8800-0fcad2780bc1 tempest-VolumesNegativeTest-1386442642 tempest-VolumesNegativeTest-1386442642-project] Action: 'create', calling method: .version_select at 0x7f5036bc78b0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-607442180", "metadata": {"Type": "work"}}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:03:33.272390 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-da009637-faf8-4aaf-8800-0fcad2780bc1 tempest-VolumesNegativeTest-1386442642 tempest-VolumesNegativeTest-1386442642-project] Request method failure captured: Jun 03 10:03:33.272390 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 03 10:03:33.272390 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept: application/json Jun 03 10:03:33.272390 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept-Encoding: identity Jun 03 10:03:33.272390 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Connection: close Jun 03 10:03:33.272390 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Length: 118 Jun 03 10:03:33.272390 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Type: application/json Jun 03 10:03:33.272390 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Host: 10.222.0.45 Jun 03 10:03:33.272390 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Openstack-System-Scope: None Jun 03 10:03:33.272390 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: User-Agent: python-urllib3/1.26.9 Jun 03 10:03:33.272390 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Auth-Token: gAAAAABimdx05pQXeqXfFTZh9iegmKzAJ-UbLx96h9C1MrArT81sWfPh1TDAy63RjOxQklzhgWcmFjfCMzjpyDqGOPI34yhxc-xTihIueTzjKMt_qlXhktI2NiZfjcxTsUcO0SDpwm9OsLshnLAdlxCVV-5CsfQj5fqvfQWmO_Vd05fcNf2MJUg Jun 03 10:03:33.272390 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Id: None Jun 03 10:03:33.272390 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Name: None Jun 03 10:03:33.272390 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Identity-Status: Confirmed Jun 03 10:03:33.272390 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Is-Admin-Project: True Jun 03 10:03:33.272390 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Id: default Jun 03 10:03:33.272390 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Name: Default Jun 03 10:03:33.272390 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Id: c7abb0ba7999459d9a200eeb1c17f505 Jun 03 10:03:33.272390 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Name: tempest-VolumesNegativeTest-1386442642 Jun 03 10:03:33.272390 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Role: member,reader Jun 03 10:03:33.272390 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Roles: member,reader Jun 03 10:03:33.273965 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c7abb0ba7999459d9a200eeb1c17f505", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c7abb0ba7999459d9a200eeb1c17f505"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c7abb0ba7999459d9a200eeb1c17f505"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c7abb0ba7999459d9a200eeb1c17f505"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 10:03:33.273965 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant: tempest-VolumesNegativeTest-1386442642 Jun 03 10:03:33.273965 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Id: c7abb0ba7999459d9a200eeb1c17f505 Jun 03 10:03:33.273965 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Name: tempest-VolumesNegativeTest-1386442642 Jun 03 10:03:33.273965 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User: tempest-VolumesNegativeTest-1386442642-project Jun 03 10:03:33.273965 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Id: default Jun 03 10:03:33.273965 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Name: Default Jun 03 10:03:33.273965 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Id: 3aad8a223c79474a83cd42410f7b4d12 Jun 03 10:03:33.273965 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Name: tempest-VolumesNegativeTest-1386442642-project Jun 03 10:03:33.273965 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Jun 03 10:03:33.273965 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-607442180", "metadata": {"Type": "work"}}} Jun 03 10:03:33.273965 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: method: Jun 03 10:03:33.273965 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 03 10:03:33.275059 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-607442180', 'metadata': {'Type': 'work'}}}} Jun 03 10:03:33.275059 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:03:33.275059 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:03:33.275059 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 03 10:03:33.275059 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 03 10:03:33.275059 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 03 10:03:33.275059 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise error Jun 03 10:03:33.275059 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 03 10:03:33.275059 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:03:33.275059 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 03 10:03:33.275059 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 03 10:03:33.275059 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:03:33.275059 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 03 10:03:33.275059 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi '' Jun 03 10:03:33.275059 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:03:33.275059 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:03:33.275059 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:03:33.275059 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:03:33.275059 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:03:33.275059 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:03:33.275059 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:03:33.275059 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:03:33.276631 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 10:03:33.276631 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 10:03:33.276631 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:03:33.276631 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:03:33.276631 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 03 10:03:33.276631 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 03 10:03:33.276631 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 03 10:03:33.276631 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 03 10:03:33.276631 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 03 10:03:33.276631 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 03 10:03:33.276631 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 03 10:03:33.276631 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:03:33.276631 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:03:33.276631 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:03:33.276631 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:03:33.276631 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:03:33.276631 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:03:33.276631 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 03 10:03:33.276631 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 03 10:03:33.278281 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 03 10:03:33.278281 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:03:33.278281 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-da009637-faf8-4aaf-8800-0fcad2780bc1 tempest-VolumesNegativeTest-1386442642 tempest-VolumesNegativeTest-1386442642-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:03:33.278281 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-da009637-faf8-4aaf-8800-0fcad2780bc1 tempest-VolumesNegativeTest-1386442642 tempest-VolumesNegativeTest-1386442642-project] 10.222.0.45 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007586 Jun 03 10:03:33.278281 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 387/814] 10.222.0.45 () {60 vars in 1155 bytes} [Fri Jun 3 10:03:33 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 03 10:03:33.282997 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-091c4d1d-f736-41e1-8d39-efef5003761a tempest-VolumesNegativeTest-1386442642 tempest-VolumesNegativeTest-1386442642-project] Calling method '.version_select at 0x7f5036ad3b80>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:33.311711 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.wsgi [None req-091c4d1d-f736-41e1-8d39-efef5003761a tempest-VolumesNegativeTest-1386442642 tempest-VolumesNegativeTest-1386442642-project] HTTP exception thrown: Volume tempest-invalid-1593022481 could not be found. Jun 03 10:03:33.313624 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-091c4d1d-f736-41e1-8d39-efef5003761a tempest-VolumesNegativeTest-1386442642 tempest-VolumesNegativeTest-1386442642-project] Request method failure captured: Jun 03 10:03:33.313624 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1593022481 HTTP/1.1 Jun 03 10:03:33.313624 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Accept: application/json Jun 03 10:03:33.313624 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Accept-Encoding: identity Jun 03 10:03:33.313624 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Connection: close Jun 03 10:03:33.313624 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Content-Length: 0 Jun 03 10:03:33.313624 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Content-Type: application/json Jun 03 10:03:33.313624 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Host: 10.222.0.45 Jun 03 10:03:33.313624 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Openstack-System-Scope: None Jun 03 10:03:33.313624 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: User-Agent: python-urllib3/1.26.9 Jun 03 10:03:33.313624 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Auth-Token: gAAAAABimdx05pQXeqXfFTZh9iegmKzAJ-UbLx96h9C1MrArT81sWfPh1TDAy63RjOxQklzhgWcmFjfCMzjpyDqGOPI34yhxc-xTihIueTzjKMt_qlXhktI2NiZfjcxTsUcO0SDpwm9OsLshnLAdlxCVV-5CsfQj5fqvfQWmO_Vd05fcNf2MJUg Jun 03 10:03:33.313624 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Domain-Id: None Jun 03 10:03:33.313624 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Domain-Name: None Jun 03 10:03:33.313624 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Identity-Status: Confirmed Jun 03 10:03:33.313624 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Is-Admin-Project: True Jun 03 10:03:33.313624 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Domain-Id: default Jun 03 10:03:33.313624 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Domain-Name: Default Jun 03 10:03:33.313624 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Id: c7abb0ba7999459d9a200eeb1c17f505 Jun 03 10:03:33.313624 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Name: tempest-VolumesNegativeTest-1386442642 Jun 03 10:03:33.313624 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Role: member,reader Jun 03 10:03:33.313624 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Roles: member,reader Jun 03 10:03:33.314933 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c7abb0ba7999459d9a200eeb1c17f505", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c7abb0ba7999459d9a200eeb1c17f505"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c7abb0ba7999459d9a200eeb1c17f505"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c7abb0ba7999459d9a200eeb1c17f505"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 10:03:33.314933 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant: tempest-VolumesNegativeTest-1386442642 Jun 03 10:03:33.314933 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant-Id: c7abb0ba7999459d9a200eeb1c17f505 Jun 03 10:03:33.314933 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant-Name: tempest-VolumesNegativeTest-1386442642 Jun 03 10:03:33.314933 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User: tempest-VolumesNegativeTest-1386442642-project Jun 03 10:03:33.314933 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Domain-Id: default Jun 03 10:03:33.314933 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Domain-Name: Default Jun 03 10:03:33.314933 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Id: 3aad8a223c79474a83cd42410f7b4d12 Jun 03 10:03:33.314933 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Name: tempest-VolumesNegativeTest-1386442642-project Jun 03 10:03:33.314933 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: method: Jun 03 10:03:33.314933 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: exception: Volume tempest-invalid-1593022481 could not be found. Jun 03 10:03:33.314933 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: action_args: {'id': 'tempest-invalid-1593022481'} Jun 03 10:03:33.314933 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:03:33.315854 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:03:33.315854 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 10:03:33.315854 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 10:03:33.315854 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 03 10:03:33.315854 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 03 10:03:33.315854 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 03 10:03:33.315854 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 03 10:03:33.315854 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 03 10:03:33.315854 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 03 10:03:33.315854 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 03 10:03:33.315854 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 03 10:03:33.315854 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 10:03:33.315854 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 10:03:33.315854 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 10:03:33.315854 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 10:03:33.315854 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1593022481 could not be found. (HTTP 404) (Request-ID: req-6e36ae45-9a69-4656-abaa-ebfd3083c850) Jun 03 10:03:33.315854 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:03:33.315854 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:03:33.315854 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:03:33.317924 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:03:33.317924 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 03 10:03:33.317924 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 03 10:03:33.317924 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 10:03:33.317924 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 10:03:33.317924 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 03 10:03:33.317924 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 03 10:03:33.317924 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 10:03:33.317924 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 10:03:33.317924 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 10:03:33.317924 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 10:03:33.317924 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 03 10:03:33.317924 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 03 10:03:33.317924 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 03 10:03:33.317924 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 03 10:03:33.317924 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 03 10:03:33.317924 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 03 10:03:33.317924 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 03 10:03:33.317924 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 03 10:03:33.319093 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 10:03:33.319093 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 10:03:33.319093 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 10:03:33.319093 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 10:03:33.319093 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1593022481 could not be found. Jun 03 10:03:33.319093 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:03:33.319093 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:03:33.319093 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:03:33.319093 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:03:33.319093 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:03:33.319093 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:03:33.319093 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:03:33.319093 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:03:33.319093 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 10:03:33.319093 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 10:03:33.319093 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:03:33.319093 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:03:33.319093 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 03 10:03:33.319093 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:03:33.319093 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1593022481 could not be found. Jun 03 10:03:33.320662 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:03:33.320662 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:03:33.320662 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:03:33.320662 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:03:33.320662 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:03:33.320662 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:03:33.320662 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:03:33.320662 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:03:33.320662 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1593022481 could not be found. Jun 03 10:03:33.320662 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:03:33.320662 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-091c4d1d-f736-41e1-8d39-efef5003761a tempest-VolumesNegativeTest-1386442642 tempest-VolumesNegativeTest-1386442642-project] Returning 404 to user: Volume tempest-invalid-1593022481 could not be found. {{(pid=117647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:03:33.320662 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-091c4d1d-f736-41e1-8d39-efef5003761a tempest-VolumesNegativeTest-1386442642 tempest-VolumesNegativeTest-1386442642-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1593022481" status: 404 len: 99 microversion: 2.1 time: 0.036202 Jun 03 10:03:33.320662 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 428/815] 10.222.0.45 () {58 vars in 1217 bytes} [Fri Jun 3 10:03:33 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1593022481 => generated 99 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 03 10:03:33.327103 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-72bd241c-c1a5-4689-afd4-ecd30e15d32d tempest-VolumesNegativeTest-1386442642 tempest-VolumesNegativeTest-1386442642-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003800 Jun 03 10:03:33.327760 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 388/816] 10.222.0.45 () {58 vars in 1139 bytes} [Fri Jun 3 10:03:33 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 03 10:03:33.336645 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-31638694-af8d-48b7-9a14-542fbc1d151a tempest-VolumesNegativeTest-1386442642 tempest-VolumesNegativeTest-1386442642-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003971 Jun 03 10:03:33.337143 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 429/817] 10.222.0.45 () {58 vars in 1136 bytes} [Fri Jun 3 10:03:33 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 03 10:03:33.346117 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-c47533f5-5317-4362-b6e3-8246aa920bc8 tempest-VolumesNegativeTest-1386442642 tempest-VolumesNegativeTest-1386442642-project] Calling method '.version_select at 0x7f5036bc7280>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:33.374644 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.wsgi [None req-c47533f5-5317-4362-b6e3-8246aa920bc8 tempest-VolumesNegativeTest-1386442642 tempest-VolumesNegativeTest-1386442642-project] HTTP exception thrown: Volume 31960725-7b7d-4d33-b382-72adbbff4e30 could not be found. Jun 03 10:03:33.376694 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-c47533f5-5317-4362-b6e3-8246aa920bc8 tempest-VolumesNegativeTest-1386442642 tempest-VolumesNegativeTest-1386442642-project] Request method failure captured: Jun 03 10:03:33.376694 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: request: DELETE /compute/v2.1/os-volumes/31960725-7b7d-4d33-b382-72adbbff4e30 HTTP/1.1 Jun 03 10:03:33.376694 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept: application/json Jun 03 10:03:33.376694 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept-Encoding: identity Jun 03 10:03:33.376694 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Connection: close Jun 03 10:03:33.376694 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Length: 0 Jun 03 10:03:33.376694 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Type: application/json Jun 03 10:03:33.376694 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Host: 10.222.0.45 Jun 03 10:03:33.376694 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Openstack-System-Scope: None Jun 03 10:03:33.376694 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: User-Agent: python-urllib3/1.26.9 Jun 03 10:03:33.376694 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Auth-Token: gAAAAABimdx05pQXeqXfFTZh9iegmKzAJ-UbLx96h9C1MrArT81sWfPh1TDAy63RjOxQklzhgWcmFjfCMzjpyDqGOPI34yhxc-xTihIueTzjKMt_qlXhktI2NiZfjcxTsUcO0SDpwm9OsLshnLAdlxCVV-5CsfQj5fqvfQWmO_Vd05fcNf2MJUg Jun 03 10:03:33.376694 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Id: None Jun 03 10:03:33.376694 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Name: None Jun 03 10:03:33.376694 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Identity-Status: Confirmed Jun 03 10:03:33.376694 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Is-Admin-Project: True Jun 03 10:03:33.376694 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Id: default Jun 03 10:03:33.376694 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Name: Default Jun 03 10:03:33.376694 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Id: c7abb0ba7999459d9a200eeb1c17f505 Jun 03 10:03:33.376694 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Name: tempest-VolumesNegativeTest-1386442642 Jun 03 10:03:33.376694 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Role: member,reader Jun 03 10:03:33.376694 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Roles: member,reader Jun 03 10:03:33.378105 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c7abb0ba7999459d9a200eeb1c17f505", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c7abb0ba7999459d9a200eeb1c17f505"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c7abb0ba7999459d9a200eeb1c17f505"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c7abb0ba7999459d9a200eeb1c17f505"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 10:03:33.378105 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant: tempest-VolumesNegativeTest-1386442642 Jun 03 10:03:33.378105 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Id: c7abb0ba7999459d9a200eeb1c17f505 Jun 03 10:03:33.378105 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Name: tempest-VolumesNegativeTest-1386442642 Jun 03 10:03:33.378105 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User: tempest-VolumesNegativeTest-1386442642-project Jun 03 10:03:33.378105 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Id: default Jun 03 10:03:33.378105 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Name: Default Jun 03 10:03:33.378105 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Id: 3aad8a223c79474a83cd42410f7b4d12 Jun 03 10:03:33.378105 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Name: tempest-VolumesNegativeTest-1386442642-project Jun 03 10:03:33.378105 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: method: Jun 03 10:03:33.378105 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: exception: Volume 31960725-7b7d-4d33-b382-72adbbff4e30 could not be found. Jun 03 10:03:33.378105 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: action_args: {'id': '31960725-7b7d-4d33-b382-72adbbff4e30'} Jun 03 10:03:33.378105 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:03:33.379319 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:03:33.379319 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 10:03:33.379319 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 10:03:33.379319 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 03 10:03:33.379319 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 03 10:03:33.379319 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 03 10:03:33.379319 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 03 10:03:33.379319 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 03 10:03:33.379319 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 03 10:03:33.379319 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 03 10:03:33.379319 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 03 10:03:33.379319 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 10:03:33.379319 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 10:03:33.379319 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 10:03:33.379319 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 10:03:33.379319 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 31960725-7b7d-4d33-b382-72adbbff4e30 could not be found. (HTTP 404) (Request-ID: req-6df06598-8184-4d05-8050-f41d4dd87dc8) Jun 03 10:03:33.379319 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:03:33.379319 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:03:33.379319 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:03:33.381115 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:03:33.381115 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 03 10:03:33.381115 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 03 10:03:33.381115 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 10:03:33.381115 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 10:03:33.381115 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 03 10:03:33.381115 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 03 10:03:33.381115 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 10:03:33.381115 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 10:03:33.381115 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 10:03:33.381115 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 10:03:33.381115 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 03 10:03:33.381115 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 03 10:03:33.381115 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 03 10:03:33.381115 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 03 10:03:33.381115 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 03 10:03:33.381115 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 03 10:03:33.381115 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 03 10:03:33.381115 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 03 10:03:33.382361 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 10:03:33.382361 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 10:03:33.382361 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 10:03:33.382361 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 10:03:33.382361 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 31960725-7b7d-4d33-b382-72adbbff4e30 could not be found. Jun 03 10:03:33.382361 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:03:33.382361 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:03:33.382361 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:03:33.382361 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:03:33.382361 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:03:33.382361 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:03:33.382361 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:03:33.382361 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:03:33.382361 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 10:03:33.382361 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 10:03:33.382361 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:03:33.382361 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:03:33.382361 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 03 10:03:33.382361 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:03:33.383691 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 31960725-7b7d-4d33-b382-72adbbff4e30 could not be found. Jun 03 10:03:33.383691 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:03:33.383691 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:03:33.383691 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:03:33.383691 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:03:33.383691 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:03:33.383691 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:03:33.383691 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:03:33.383691 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:03:33.383691 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 31960725-7b7d-4d33-b382-72adbbff4e30 could not be found. Jun 03 10:03:33.383691 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:03:33.383691 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-c47533f5-5317-4362-b6e3-8246aa920bc8 tempest-VolumesNegativeTest-1386442642 tempest-VolumesNegativeTest-1386442642-project] Returning 404 to user: Volume 31960725-7b7d-4d33-b382-72adbbff4e30 could not be found. {{(pid=117648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:03:33.383691 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-c47533f5-5317-4362-b6e3-8246aa920bc8 tempest-VolumesNegativeTest-1386442642 tempest-VolumesNegativeTest-1386442642-project] 10.222.0.45 "DELETE /compute/v2.1/os-volumes/31960725-7b7d-4d33-b382-72adbbff4e30" status: 404 len: 109 microversion: 2.1 time: 0.036335 Jun 03 10:03:33.383691 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 389/818] 10.222.0.45 () {58 vars in 1247 bytes} [Fri Jun 3 10:03:33 2022] DELETE /compute/v2.1/os-volumes/31960725-7b7d-4d33-b382-72adbbff4e30 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 10:03:33.394450 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-72565a56-e891-491c-880b-298d502c3c6b tempest-VolumesNegativeTest-1386442642 tempest-VolumesNegativeTest-1386442642-project] Calling method '.version_select at 0x7f5036ad3ca0>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:33.422223 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.wsgi [None req-72565a56-e891-491c-880b-298d502c3c6b tempest-VolumesNegativeTest-1386442642 tempest-VolumesNegativeTest-1386442642-project] HTTP exception thrown: Volume 2fce9c0d-7d05-48d8-98c7-f22322fea293 could not be found. Jun 03 10:03:33.424202 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-72565a56-e891-491c-880b-298d502c3c6b tempest-VolumesNegativeTest-1386442642 tempest-VolumesNegativeTest-1386442642-project] Request method failure captured: Jun 03 10:03:33.424202 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: request: GET /compute/v2.1/os-volumes/2fce9c0d-7d05-48d8-98c7-f22322fea293 HTTP/1.1 Jun 03 10:03:33.424202 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Accept: application/json Jun 03 10:03:33.424202 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Accept-Encoding: identity Jun 03 10:03:33.424202 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Connection: close Jun 03 10:03:33.424202 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Content-Length: 0 Jun 03 10:03:33.424202 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Content-Type: application/json Jun 03 10:03:33.424202 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Host: 10.222.0.45 Jun 03 10:03:33.424202 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Openstack-System-Scope: None Jun 03 10:03:33.424202 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: User-Agent: python-urllib3/1.26.9 Jun 03 10:03:33.424202 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Auth-Token: gAAAAABimdx05pQXeqXfFTZh9iegmKzAJ-UbLx96h9C1MrArT81sWfPh1TDAy63RjOxQklzhgWcmFjfCMzjpyDqGOPI34yhxc-xTihIueTzjKMt_qlXhktI2NiZfjcxTsUcO0SDpwm9OsLshnLAdlxCVV-5CsfQj5fqvfQWmO_Vd05fcNf2MJUg Jun 03 10:03:33.424202 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Domain-Id: None Jun 03 10:03:33.424202 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Domain-Name: None Jun 03 10:03:33.424202 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Identity-Status: Confirmed Jun 03 10:03:33.424202 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Is-Admin-Project: True Jun 03 10:03:33.424202 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Domain-Id: default Jun 03 10:03:33.424202 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Domain-Name: Default Jun 03 10:03:33.424202 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Id: c7abb0ba7999459d9a200eeb1c17f505 Jun 03 10:03:33.424202 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Name: tempest-VolumesNegativeTest-1386442642 Jun 03 10:03:33.424202 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Role: member,reader Jun 03 10:03:33.424202 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Roles: member,reader Jun 03 10:03:33.425832 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_c7abb0ba7999459d9a200eeb1c17f505", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/c7abb0ba7999459d9a200eeb1c17f505"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c7abb0ba7999459d9a200eeb1c17f505"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/c7abb0ba7999459d9a200eeb1c17f505"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 10:03:33.425832 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant: tempest-VolumesNegativeTest-1386442642 Jun 03 10:03:33.425832 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant-Id: c7abb0ba7999459d9a200eeb1c17f505 Jun 03 10:03:33.425832 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant-Name: tempest-VolumesNegativeTest-1386442642 Jun 03 10:03:33.425832 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User: tempest-VolumesNegativeTest-1386442642-project Jun 03 10:03:33.425832 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Domain-Id: default Jun 03 10:03:33.425832 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Domain-Name: Default Jun 03 10:03:33.425832 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Id: 3aad8a223c79474a83cd42410f7b4d12 Jun 03 10:03:33.425832 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Name: tempest-VolumesNegativeTest-1386442642-project Jun 03 10:03:33.425832 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: method: Jun 03 10:03:33.425832 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: exception: Volume 2fce9c0d-7d05-48d8-98c7-f22322fea293 could not be found. Jun 03 10:03:33.425832 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: action_args: {'id': '2fce9c0d-7d05-48d8-98c7-f22322fea293'} Jun 03 10:03:33.425832 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:03:33.426785 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:03:33.426785 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 10:03:33.426785 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 10:03:33.426785 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 10:03:33.426785 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 10:03:33.426785 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 10:03:33.426785 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 10:03:33.426785 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 10:03:33.426785 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 10:03:33.426785 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 10:03:33.426785 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 10:03:33.426785 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 10:03:33.426785 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 10:03:33.426785 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 10:03:33.426785 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 10:03:33.426785 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2fce9c0d-7d05-48d8-98c7-f22322fea293 could not be found. (HTTP 404) (Request-ID: req-3477ab40-8aa1-4f3f-91c6-3c6074ff6013) Jun 03 10:03:33.426785 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:03:33.426785 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:03:33.426785 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:03:33.428187 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:03:33.428187 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 03 10:03:33.428187 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 03 10:03:33.428187 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 03 10:03:33.428187 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 03 10:03:33.428187 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 03 10:03:33.428187 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 03 10:03:33.428187 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 03 10:03:33.428187 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 03 10:03:33.428187 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 03 10:03:33.428187 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 03 10:03:33.428187 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 03 10:03:33.428187 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 03 10:03:33.428187 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 03 10:03:33.428187 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 03 10:03:33.428187 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 03 10:03:33.428187 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 03 10:03:33.428187 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 03 10:03:33.428187 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 03 10:03:33.429457 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 03 10:03:33.429457 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 03 10:03:33.429457 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 03 10:03:33.429457 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 03 10:03:33.429457 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2fce9c0d-7d05-48d8-98c7-f22322fea293 could not be found. Jun 03 10:03:33.429457 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:03:33.429457 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:03:33.429457 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:03:33.429457 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:03:33.429457 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:03:33.429457 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:03:33.429457 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:03:33.429457 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:03:33.429457 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 03 10:03:33.429457 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 03 10:03:33.429457 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:03:33.429457 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:03:33.429457 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 03 10:03:33.429457 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:03:33.430709 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2fce9c0d-7d05-48d8-98c7-f22322fea293 could not be found. Jun 03 10:03:33.430709 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:03:33.430709 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:03:33.430709 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:03:33.430709 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:03:33.430709 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:03:33.430709 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:03:33.430709 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:03:33.430709 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:03:33.430709 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2fce9c0d-7d05-48d8-98c7-f22322fea293 could not be found. Jun 03 10:03:33.430709 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:03:33.430709 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-72565a56-e891-491c-880b-298d502c3c6b tempest-VolumesNegativeTest-1386442642 tempest-VolumesNegativeTest-1386442642-project] Returning 404 to user: Volume 2fce9c0d-7d05-48d8-98c7-f22322fea293 could not be found. {{(pid=117647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:03:33.430709 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-72565a56-e891-491c-880b-298d502c3c6b tempest-VolumesNegativeTest-1386442642 tempest-VolumesNegativeTest-1386442642-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/2fce9c0d-7d05-48d8-98c7-f22322fea293" status: 404 len: 109 microversion: 2.1 time: 0.035541 Jun 03 10:03:33.430709 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 430/819] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Jun 3 10:03:33 2022] GET /compute/v2.1/os-volumes/2fce9c0d-7d05-48d8-98c7-f22322fea293 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 10:03:34.003311 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-84fc55b2-3102-4114-b601-8ebae0efafb2 req-ec7ad9f1-d4d9-4571-9505-eeadadc7b092 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aaaa62d-a26a-4cde-8ee5-151fde85889d", "name": "network-vif-plugged", "status": "completed", "tag": "2990d842-a125-4da9-948a-c2237e5cbd36"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:03:34.015492 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-84fc55b2-3102-4114-b601-8ebae0efafb2 req-ec7ad9f1-d4d9-4571-9505-eeadadc7b092 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:34.016008 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-84fc55b2-3102-4114-b601-8ebae0efafb2 req-ec7ad9f1-d4d9-4571-9505-eeadadc7b092 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:34.027866 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-84fc55b2-3102-4114-b601-8ebae0efafb2 req-ec7ad9f1-d4d9-4571-9505-eeadadc7b092 service nova] Creating event network-vif-plugged:2990d842-a125-4da9-948a-c2237e5cbd36 for instance 2aaaa62d-a26a-4cde-8ee5-151fde85889d on hv-cinder-79760 Jun 03 10:03:34.033368 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-84fc55b2-3102-4114-b601-8ebae0efafb2 req-ec7ad9f1-d4d9-4571-9505-eeadadc7b092 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034485 Jun 03 10:03:34.034262 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 390/820] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:03:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:03:34.109264 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-8c104b71-18e6-4a89-9863-03d779c8f716 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:34.110026 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-8c104b71-18e6-4a89-9863-03d779c8f716 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: 2aaaa62d-a26a-4cde-8ee5-151fde85889d] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:34.117116 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8c104b71-18e6-4a89-9863-03d779c8f716 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:34.117561 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8c104b71-18e6-4a89-9863-03d779c8f716 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:34.118346 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8c104b71-18e6-4a89-9863-03d779c8f716 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:34.118778 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8c104b71-18e6-4a89-9863-03d779c8f716 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:34.262689 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-8c104b71-18e6-4a89-9863-03d779c8f716 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:34.271023 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-8c104b71-18e6-4a89-9863-03d779c8f716 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/2aaaa62d-a26a-4cde-8ee5-151fde85889d" status: 200 len: 1266 microversion: 2.1 time: 0.167187 Jun 03 10:03:34.271681 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 431/821] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:34 2022] GET /compute/v2.1/servers/2aaaa62d-a26a-4cde-8ee5-151fde85889d => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:35.289572 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-17585e4e-1e78-4620-b1e8-2395b8f57f74 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:35.290305 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-17585e4e-1e78-4620-b1e8-2395b8f57f74 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: 2aaaa62d-a26a-4cde-8ee5-151fde85889d] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:35.297101 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-17585e4e-1e78-4620-b1e8-2395b8f57f74 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:35.297779 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-17585e4e-1e78-4620-b1e8-2395b8f57f74 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:35.298547 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-17585e4e-1e78-4620-b1e8-2395b8f57f74 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:35.299115 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-17585e4e-1e78-4620-b1e8-2395b8f57f74 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:35.439463 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-17585e4e-1e78-4620-b1e8-2395b8f57f74 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:35.446120 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:03:35.449026 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-17585e4e-1e78-4620-b1e8-2395b8f57f74 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/2aaaa62d-a26a-4cde-8ee5-151fde85889d" status: 200 len: 1266 microversion: 2.1 time: 0.164414 Jun 03 10:03:35.449686 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 391/822] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:35 2022] GET /compute/v2.1/servers/2aaaa62d-a26a-4cde-8ee5-151fde85889d => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:36.465446 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-0ace0613-b967-4059-90d4-7c2dfdd1a731 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:36.466138 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-0ace0613-b967-4059-90d4-7c2dfdd1a731 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: 2aaaa62d-a26a-4cde-8ee5-151fde85889d] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:36.473108 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0ace0613-b967-4059-90d4-7c2dfdd1a731 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:36.473551 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0ace0613-b967-4059-90d4-7c2dfdd1a731 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:36.474340 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0ace0613-b967-4059-90d4-7c2dfdd1a731 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:36.474769 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0ace0613-b967-4059-90d4-7c2dfdd1a731 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:36.605056 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-0ace0613-b967-4059-90d4-7c2dfdd1a731 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:36.612490 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-0ace0613-b967-4059-90d4-7c2dfdd1a731 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/2aaaa62d-a26a-4cde-8ee5-151fde85889d" status: 200 len: 1454 microversion: 2.1 time: 0.150973 Jun 03 10:03:36.613050 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 432/823] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:36 2022] GET /compute/v2.1/servers/2aaaa62d-a26a-4cde-8ee5-151fde85889d => generated 1454 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:36.629092 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-1912efb7-e18c-4e3b-ac45-340a6c43f09e tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:36.629731 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-1912efb7-e18c-4e3b-ac45-340a6c43f09e tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: 2aaaa62d-a26a-4cde-8ee5-151fde85889d] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:36.636631 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1912efb7-e18c-4e3b-ac45-340a6c43f09e tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:36.637288 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1912efb7-e18c-4e3b-ac45-340a6c43f09e tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:36.637913 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1912efb7-e18c-4e3b-ac45-340a6c43f09e tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:36.638355 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1912efb7-e18c-4e3b-ac45-340a6c43f09e tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:36.780524 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-1912efb7-e18c-4e3b-ac45-340a6c43f09e tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:36.789387 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-1912efb7-e18c-4e3b-ac45-340a6c43f09e tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/2aaaa62d-a26a-4cde-8ee5-151fde85889d" status: 200 len: 1454 microversion: 2.1 time: 0.164402 Jun 03 10:03:36.790114 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 392/824] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:36 2022] GET /compute/v2.1/servers/2aaaa62d-a26a-4cde-8ee5-151fde85889d => generated 1454 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:38.390268 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-24e3c32e-81f4-4aad-90fc-8fd3fb773d63 req-84a0a98e-955e-4f6c-b65a-2ed4bf2a9c24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2aaaa62d-a26a-4cde-8ee5-151fde85889d", "tag": "2990d842-a125-4da9-948a-c2237e5cbd36"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:03:38.399733 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-24e3c32e-81f4-4aad-90fc-8fd3fb773d63 req-84a0a98e-955e-4f6c-b65a-2ed4bf2a9c24 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:38.400182 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-24e3c32e-81f4-4aad-90fc-8fd3fb773d63 req-84a0a98e-955e-4f6c-b65a-2ed4bf2a9c24 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:38.413496 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-24e3c32e-81f4-4aad-90fc-8fd3fb773d63 req-84a0a98e-955e-4f6c-b65a-2ed4bf2a9c24 service nova] Creating event network-changed:2990d842-a125-4da9-948a-c2237e5cbd36 for instance 2aaaa62d-a26a-4cde-8ee5-151fde85889d on hv-cinder-79760 Jun 03 10:03:38.418677 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-24e3c32e-81f4-4aad-90fc-8fd3fb773d63 req-84a0a98e-955e-4f6c-b65a-2ed4bf2a9c24 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032050 Jun 03 10:03:38.419263 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 433/825] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:03:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:03:42.768709 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-411e2200-fa17-404c-a666-d5a881e93826 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "96c08eab-0f3b-4f71-9d6d-cb780b3efd01"}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:03:42.769864 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-411e2200-fa17-404c-a666-d5a881e93826 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: b85ca18b-9b76-43c9-af4d-d7bf77231976] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:42.771889 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:03:42.777484 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-411e2200-fa17-404c-a666-d5a881e93826 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:42.778168 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-411e2200-fa17-404c-a666-d5a881e93826 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:42.779008 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-411e2200-fa17-404c-a666-d5a881e93826 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:42.779456 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-411e2200-fa17-404c-a666-d5a881e93826 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:42.861335 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.wsgi [None req-411e2200-fa17-404c-a666-d5a881e93826 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] HTTP exception thrown: Invalid volume: volume 96c08eab-0f3b-4f71-9d6d-cb780b3efd01 is already attached to instances: b85ca18b-9b76-43c9-af4d-d7bf77231976 Jun 03 10:03:42.863219 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-411e2200-fa17-404c-a666-d5a881e93826 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Request method failure captured: Jun 03 10:03:42.863219 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: request: POST /compute/v2.1/servers/b85ca18b-9b76-43c9-af4d-d7bf77231976/os-volume_attachments HTTP/1.1 Jun 03 10:03:42.863219 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept: application/json Jun 03 10:03:42.863219 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept-Encoding: identity Jun 03 10:03:42.863219 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Connection: close Jun 03 10:03:42.863219 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Length: 74 Jun 03 10:03:42.863219 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Type: application/json Jun 03 10:03:42.863219 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Host: 10.222.0.45 Jun 03 10:03:42.863219 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Openstack-System-Scope: None Jun 03 10:03:42.863219 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: User-Agent: python-urllib3/1.26.9 Jun 03 10:03:42.863219 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Auth-Token: gAAAAABimdrmmGMJYoFEaixKtEm5TQ4XA5jgCy5iwX6ZjbOH9DxrKeyENuD4peBUKmdWr-PDWrDLYLLxy5lixGd2HlPi4aZlZBg9FmZSE7U7_CN_FIxjIovt53hs7DTTUFYYhZcU3_b0MiLpd7TSlEfGmsHpIrMSk9dkjlfpCuRH8mQ4nPiTBOs Jun 03 10:03:42.863219 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Id: None Jun 03 10:03:42.863219 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Name: None Jun 03 10:03:42.863219 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Identity-Status: Confirmed Jun 03 10:03:42.863219 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Is-Admin-Project: True Jun 03 10:03:42.863219 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Id: default Jun 03 10:03:42.863219 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Name: Default Jun 03 10:03:42.863219 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Id: 12d4ca628b894615bc311c3705c4a801 Jun 03 10:03:42.863219 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Name: tempest-AttachVolumeNegativeTest-1776358070 Jun 03 10:03:42.863219 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Role: member,reader Jun 03 10:03:42.863219 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Roles: member,reader Jun 03 10:03:42.864846 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_12d4ca628b894615bc311c3705c4a801", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/12d4ca628b894615bc311c3705c4a801"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/12d4ca628b894615bc311c3705c4a801"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/12d4ca628b894615bc311c3705c4a801"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 10:03:42.864846 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant: tempest-AttachVolumeNegativeTest-1776358070 Jun 03 10:03:42.864846 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Id: 12d4ca628b894615bc311c3705c4a801 Jun 03 10:03:42.864846 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1776358070 Jun 03 10:03:42.864846 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User: tempest-AttachVolumeNegativeTest-1776358070-project Jun 03 10:03:42.864846 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Id: default Jun 03 10:03:42.864846 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Name: Default Jun 03 10:03:42.864846 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Id: e62d9d781281497e9927c0eb0e85dd75 Jun 03 10:03:42.864846 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Name: tempest-AttachVolumeNegativeTest-1776358070-project Jun 03 10:03:42.864846 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Jun 03 10:03:42.864846 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: {"volumeAttachment": {"volumeId": "96c08eab-0f3b-4f71-9d6d-cb780b3efd01"}} Jun 03 10:03:42.864846 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: method: > Jun 03 10:03:42.865799 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: exception: Invalid volume: volume 96c08eab-0f3b-4f71-9d6d-cb780b3efd01 is already attached to instances: b85ca18b-9b76-43c9-af4d-d7bf77231976 Jun 03 10:03:42.865799 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: action_args: {'server_id': 'b85ca18b-9b76-43c9-af4d-d7bf77231976', 'body': {'volumeAttachment': {'volumeId': '96c08eab-0f3b-4f71-9d6d-cb780b3efd01'}}} Jun 03 10:03:42.865799 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:03:42.865799 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:03:42.865799 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 03 10:03:42.865799 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 03 10:03:42.865799 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 03 10:03:42.865799 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 03 10:03:42.865799 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 03 10:03:42.865799 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 03 10:03:42.865799 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 03 10:03:42.865799 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 03 10:03:42.865799 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 03 10:03:42.865799 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 03 10:03:42.865799 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 96c08eab-0f3b-4f71-9d6d-cb780b3efd01 is already attached to instances: b85ca18b-9b76-43c9-af4d-d7bf77231976 Jun 03 10:03:42.865799 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:03:42.865799 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:03:42.865799 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:03:42.865799 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:03:42.867208 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:03:42.867208 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:03:42.867208 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:03:42.867208 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:03:42.867208 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:03:42.867208 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:03:42.867208 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 10:03:42.867208 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 10:03:42.867208 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 10:03:42.867208 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 10:03:42.867208 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 03 10:03:42.867208 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 03 10:03:42.867208 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 03 10:03:42.867208 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 03 10:03:42.867208 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 96c08eab-0f3b-4f71-9d6d-cb780b3efd01 is already attached to instances: b85ca18b-9b76-43c9-af4d-d7bf77231976 Jun 03 10:03:42.867208 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:03:42.867208 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:03:42.867208 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:03:42.867208 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:03:42.867208 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:03:42.868741 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:03:42.868741 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:03:42.868741 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:03:42.868741 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 96c08eab-0f3b-4f71-9d6d-cb780b3efd01 is already attached to instances: b85ca18b-9b76-43c9-af4d-d7bf77231976 Jun 03 10:03:42.868741 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:03:42.868741 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-411e2200-fa17-404c-a666-d5a881e93826 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Returning 400 to user: Invalid volume: volume 96c08eab-0f3b-4f71-9d6d-cb780b3efd01 is already attached to instances: b85ca18b-9b76-43c9-af4d-d7bf77231976 {{(pid=117648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:03:42.868741 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-411e2200-fa17-404c-a666-d5a881e93826 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "POST /compute/v2.1/servers/b85ca18b-9b76-43c9-af4d-d7bf77231976/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100151 Jun 03 10:03:42.868741 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 393/826] 10.222.0.45 () {60 vars in 1322 bytes} [Fri Jun 3 10:03:42 2022] POST /compute/v2.1/servers/b85ca18b-9b76-43c9-af4d-d7bf77231976/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 03 10:03:42.927333 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-027ac340-ce44-4ea0-a49e-fc0888b480d4 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:42.927928 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-027ac340-ce44-4ea0-a49e-fc0888b480d4 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: b85ca18b-9b76-43c9-af4d-d7bf77231976] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:42.934193 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-027ac340-ce44-4ea0-a49e-fc0888b480d4 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:42.934648 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-027ac340-ce44-4ea0-a49e-fc0888b480d4 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:42.936974 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-027ac340-ce44-4ea0-a49e-fc0888b480d4 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:42.937419 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-027ac340-ce44-4ea0-a49e-fc0888b480d4 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:43.018483 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.objects.instance [None req-027ac340-ce44-4ea0-a49e-fc0888b480d4 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lazy-loading 'services' on Instance uuid b85ca18b-9b76-43c9-af4d-d7bf77231976 {{(pid=117647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:03:43.089590 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-027ac340-ce44-4ea0-a49e-fc0888b480d4 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b85ca18b-9b76-43c9-af4d-d7bf77231976/os-volume_attachments/96c08eab-0f3b-4f71-9d6d-cb780b3efd01" status: 202 len: 0 microversion: 2.1 time: 0.166926 Jun 03 10:03:43.090475 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 434/827] 10.222.0.45 () {58 vars in 1415 bytes} [Fri Jun 3 10:03:42 2022] DELETE /compute/v2.1/servers/b85ca18b-9b76-43c9-af4d-d7bf77231976/os-volume_attachments/96c08eab-0f3b-4f71-9d6d-cb780b3efd01 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 10:03:43.100462 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-4d819f9d-2275-4934-b13e-6b4ae49afe87 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:43.101527 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-4d819f9d-2275-4934-b13e-6b4ae49afe87 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: b85ca18b-9b76-43c9-af4d-d7bf77231976] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:43.109422 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4d819f9d-2275-4934-b13e-6b4ae49afe87 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:43.109953 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4d819f9d-2275-4934-b13e-6b4ae49afe87 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:43.110952 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4d819f9d-2275-4934-b13e-6b4ae49afe87 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:43.111470 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4d819f9d-2275-4934-b13e-6b4ae49afe87 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:43.144994 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-4d819f9d-2275-4934-b13e-6b4ae49afe87 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/b85ca18b-9b76-43c9-af4d-d7bf77231976/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048795 Jun 03 10:03:43.145734 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 394/828] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 3 10:03:43 2022] GET /compute/v2.1/servers/b85ca18b-9b76-43c9-af4d-d7bf77231976/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:03:44.157208 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-1e61aaed-a94f-43b1-a08e-a45250fc5b39 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:44.158282 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-1e61aaed-a94f-43b1-a08e-a45250fc5b39 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: b85ca18b-9b76-43c9-af4d-d7bf77231976] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:44.161043 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:03:44.166925 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1e61aaed-a94f-43b1-a08e-a45250fc5b39 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:44.167353 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1e61aaed-a94f-43b1-a08e-a45250fc5b39 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:44.168116 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1e61aaed-a94f-43b1-a08e-a45250fc5b39 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:44.168553 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1e61aaed-a94f-43b1-a08e-a45250fc5b39 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:44.197617 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-1e61aaed-a94f-43b1-a08e-a45250fc5b39 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/b85ca18b-9b76-43c9-af4d-d7bf77231976/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044766 Jun 03 10:03:44.198190 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 435/829] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 3 10:03:44 2022] GET /compute/v2.1/servers/b85ca18b-9b76-43c9-af4d-d7bf77231976/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 03 10:03:44.254596 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-c79395ab-5191-4428-b2f4-e53fa229539d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:44.255101 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-c79395ab-5191-4428-b2f4-e53fa229539d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: b85ca18b-9b76-43c9-af4d-d7bf77231976] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:44.261882 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c79395ab-5191-4428-b2f4-e53fa229539d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:44.262241 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c79395ab-5191-4428-b2f4-e53fa229539d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:44.262987 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c79395ab-5191-4428-b2f4-e53fa229539d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:44.263416 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c79395ab-5191-4428-b2f4-e53fa229539d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:44.287722 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-c79395ab-5191-4428-b2f4-e53fa229539d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: b85ca18b-9b76-43c9-af4d-d7bf77231976] Going to try to terminate instance {{(pid=117648) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 10:03:44.365762 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-c79395ab-5191-4428-b2f4-e53fa229539d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b85ca18b-9b76-43c9-af4d-d7bf77231976" status: 204 len: 0 microversion: 2.1 time: 0.114388 Jun 03 10:03:44.366433 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 395/830] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jun 3 10:03:44 2022] DELETE /compute/v2.1/servers/b85ca18b-9b76-43c9-af4d-d7bf77231976 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 10:03:44.375468 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-11c90652-a551-4234-93a4-e5cb7b4e2fb1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:44.376081 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-11c90652-a551-4234-93a4-e5cb7b4e2fb1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: b85ca18b-9b76-43c9-af4d-d7bf77231976] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:44.382311 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-11c90652-a551-4234-93a4-e5cb7b4e2fb1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:44.382762 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-11c90652-a551-4234-93a4-e5cb7b4e2fb1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:44.383542 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-11c90652-a551-4234-93a4-e5cb7b4e2fb1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:44.383958 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-11c90652-a551-4234-93a4-e5cb7b4e2fb1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:44.523579 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-11c90652-a551-4234-93a4-e5cb7b4e2fb1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:44.531814 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-11c90652-a551-4234-93a4-e5cb7b4e2fb1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/b85ca18b-9b76-43c9-af4d-d7bf77231976" status: 200 len: 1682 microversion: 2.1 time: 0.160974 Jun 03 10:03:44.532401 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 436/831] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:44 2022] GET /compute/v2.1/servers/b85ca18b-9b76-43c9-af4d-d7bf77231976 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:45.549368 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-764c76ac-2cc7-43f0-a1a2-67079e1b7e27 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:45.550207 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-764c76ac-2cc7-43f0-a1a2-67079e1b7e27 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: b85ca18b-9b76-43c9-af4d-d7bf77231976] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:45.556798 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-764c76ac-2cc7-43f0-a1a2-67079e1b7e27 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:45.557254 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-764c76ac-2cc7-43f0-a1a2-67079e1b7e27 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:45.558059 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-764c76ac-2cc7-43f0-a1a2-67079e1b7e27 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:45.558498 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-764c76ac-2cc7-43f0-a1a2-67079e1b7e27 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:45.690571 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-764c76ac-2cc7-43f0-a1a2-67079e1b7e27 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:45.698133 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-764c76ac-2cc7-43f0-a1a2-67079e1b7e27 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/b85ca18b-9b76-43c9-af4d-d7bf77231976" status: 200 len: 1682 microversion: 2.1 time: 0.153589 Jun 03 10:03:45.698702 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 396/832] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:45 2022] GET /compute/v2.1/servers/b85ca18b-9b76-43c9-af4d-d7bf77231976 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:46.716702 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-0d462a92-deaa-4279-b684-aac88f5bf0bd tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:46.717380 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-0d462a92-deaa-4279-b684-aac88f5bf0bd tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: b85ca18b-9b76-43c9-af4d-d7bf77231976] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:46.724182 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0d462a92-deaa-4279-b684-aac88f5bf0bd tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:46.724627 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0d462a92-deaa-4279-b684-aac88f5bf0bd tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:46.725397 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0d462a92-deaa-4279-b684-aac88f5bf0bd tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:46.725857 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0d462a92-deaa-4279-b684-aac88f5bf0bd tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:46.874474 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-0d462a92-deaa-4279-b684-aac88f5bf0bd tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:46.887415 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-0d462a92-deaa-4279-b684-aac88f5bf0bd tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/b85ca18b-9b76-43c9-af4d-d7bf77231976" status: 200 len: 1682 microversion: 2.1 time: 0.174209 Jun 03 10:03:46.888601 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 437/833] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:46 2022] GET /compute/v2.1/servers/b85ca18b-9b76-43c9-af4d-d7bf77231976 => generated 1682 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:47.380411 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-4838afc8-a09a-4036-a6ae-bfe451b29c3d req-da890749-ab1b-4532-a452-5d7f79d48b48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b85ca18b-9b76-43c9-af4d-d7bf77231976", "name": "network-vif-deleted", "tag": "5cb4beca-4bc2-4d76-9c45-84156f1ae5fb"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:03:47.400666 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-4838afc8-a09a-4036-a6ae-bfe451b29c3d req-da890749-ab1b-4532-a452-5d7f79d48b48 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:47.401428 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-4838afc8-a09a-4036-a6ae-bfe451b29c3d req-da890749-ab1b-4532-a452-5d7f79d48b48 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:47.420815 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-4838afc8-a09a-4036-a6ae-bfe451b29c3d req-da890749-ab1b-4532-a452-5d7f79d48b48 service nova] Creating event network-vif-deleted:5cb4beca-4bc2-4d76-9c45-84156f1ae5fb for instance b85ca18b-9b76-43c9-af4d-d7bf77231976 on hv-cinder-79760 Jun 03 10:03:47.428406 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-4838afc8-a09a-4036-a6ae-bfe451b29c3d req-da890749-ab1b-4532-a452-5d7f79d48b48 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050993 Jun 03 10:03:47.429640 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 397/834] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:03:47.909870 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-96790404-6e8e-4396-a41a-1be36378b07b tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:47.911264 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-96790404-6e8e-4396-a41a-1be36378b07b tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: b85ca18b-9b76-43c9-af4d-d7bf77231976] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:47.918980 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-96790404-6e8e-4396-a41a-1be36378b07b tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:47.919161 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-96790404-6e8e-4396-a41a-1be36378b07b tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:47.922734 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-96790404-6e8e-4396-a41a-1be36378b07b tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:47.923197 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-96790404-6e8e-4396-a41a-1be36378b07b tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:47.960345 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-96790404-6e8e-4396-a41a-1be36378b07b tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:47.960804 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-96790404-6e8e-4396-a41a-1be36378b07b tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:47.961313 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.objects.instance [None req-96790404-6e8e-4396-a41a-1be36378b07b tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lazy-loading 'fault' on Instance uuid b85ca18b-9b76-43c9-af4d-d7bf77231976 {{(pid=117647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:03:48.021111 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-96790404-6e8e-4396-a41a-1be36378b07b tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:48.031399 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-96790404-6e8e-4396-a41a-1be36378b07b tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/b85ca18b-9b76-43c9-af4d-d7bf77231976" status: 200 len: 1332 microversion: 2.1 time: 0.127337 Jun 03 10:03:48.033313 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 438/835] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:47 2022] GET /compute/v2.1/servers/b85ca18b-9b76-43c9-af4d-d7bf77231976 => generated 1332 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:49.050687 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-878287fc-56e4-4c82-ae2d-05edf3c5e21b tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:49.051412 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-878287fc-56e4-4c82-ae2d-05edf3c5e21b tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: b85ca18b-9b76-43c9-af4d-d7bf77231976] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:49.057578 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-878287fc-56e4-4c82-ae2d-05edf3c5e21b tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:49.058095 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-878287fc-56e4-4c82-ae2d-05edf3c5e21b tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:49.058871 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-878287fc-56e4-4c82-ae2d-05edf3c5e21b tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:49.059312 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-878287fc-56e4-4c82-ae2d-05edf3c5e21b tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:49.073142 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.wsgi [None req-878287fc-56e4-4c82-ae2d-05edf3c5e21b tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] HTTP exception thrown: Instance b85ca18b-9b76-43c9-af4d-d7bf77231976 could not be found. Jun 03 10:03:49.074814 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-878287fc-56e4-4c82-ae2d-05edf3c5e21b tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Request method failure captured: Jun 03 10:03:49.074814 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: request: GET /compute/v2.1/servers/b85ca18b-9b76-43c9-af4d-d7bf77231976 HTTP/1.1 Jun 03 10:03:49.074814 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept: application/json Jun 03 10:03:49.074814 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept-Encoding: identity Jun 03 10:03:49.074814 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Connection: close Jun 03 10:03:49.074814 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Length: 0 Jun 03 10:03:49.074814 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Type: application/json Jun 03 10:03:49.074814 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Host: 10.222.0.45 Jun 03 10:03:49.074814 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Openstack-System-Scope: None Jun 03 10:03:49.074814 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: User-Agent: python-urllib3/1.26.9 Jun 03 10:03:49.074814 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Auth-Token: gAAAAABimdrmmGMJYoFEaixKtEm5TQ4XA5jgCy5iwX6ZjbOH9DxrKeyENuD4peBUKmdWr-PDWrDLYLLxy5lixGd2HlPi4aZlZBg9FmZSE7U7_CN_FIxjIovt53hs7DTTUFYYhZcU3_b0MiLpd7TSlEfGmsHpIrMSk9dkjlfpCuRH8mQ4nPiTBOs Jun 03 10:03:49.074814 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Id: None Jun 03 10:03:49.074814 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Name: None Jun 03 10:03:49.074814 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Identity-Status: Confirmed Jun 03 10:03:49.074814 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Is-Admin-Project: True Jun 03 10:03:49.074814 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Id: default Jun 03 10:03:49.074814 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Name: Default Jun 03 10:03:49.074814 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Id: 12d4ca628b894615bc311c3705c4a801 Jun 03 10:03:49.074814 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Name: tempest-AttachVolumeNegativeTest-1776358070 Jun 03 10:03:49.074814 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Role: member,reader Jun 03 10:03:49.074814 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Roles: member,reader Jun 03 10:03:49.076402 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_12d4ca628b894615bc311c3705c4a801", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/12d4ca628b894615bc311c3705c4a801"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/12d4ca628b894615bc311c3705c4a801"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/12d4ca628b894615bc311c3705c4a801"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 10:03:49.076402 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant: tempest-AttachVolumeNegativeTest-1776358070 Jun 03 10:03:49.076402 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Id: 12d4ca628b894615bc311c3705c4a801 Jun 03 10:03:49.076402 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1776358070 Jun 03 10:03:49.076402 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User: tempest-AttachVolumeNegativeTest-1776358070-project Jun 03 10:03:49.076402 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Id: default Jun 03 10:03:49.076402 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Name: Default Jun 03 10:03:49.076402 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Id: e62d9d781281497e9927c0eb0e85dd75 Jun 03 10:03:49.076402 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Name: tempest-AttachVolumeNegativeTest-1776358070-project Jun 03 10:03:49.076402 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: method: > Jun 03 10:03:49.076402 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: exception: Instance b85ca18b-9b76-43c9-af4d-d7bf77231976 could not be found. Jun 03 10:03:49.076402 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: action_args: {'id': 'b85ca18b-9b76-43c9-af4d-d7bf77231976'} Jun 03 10:03:49.078507 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:03:49.078507 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:03:49.078507 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:03:49.078507 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:03:49.078507 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:03:49.078507 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:03:49.078507 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:03:49.078507 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:03:49.078507 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:03:49.078507 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:03:49.078507 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b85ca18b-9b76-43c9-af4d-d7bf77231976 could not be found. Jun 03 10:03:49.078507 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:03:49.078507 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:03:49.078507 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:03:49.078507 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:03:49.078507 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:03:49.078507 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:03:49.078507 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:03:49.078507 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:03:49.078507 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:03:49.079739 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:03:49.079739 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:03:49.079739 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:03:49.079739 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:03:49.079739 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:03:49.079739 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:03:49.079739 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:03:49.079739 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b85ca18b-9b76-43c9-af4d-d7bf77231976 could not be found. Jun 03 10:03:49.079739 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:03:49.079739 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:03:49.079739 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:03:49.079739 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:03:49.079739 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:03:49.079739 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:03:49.079739 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:03:49.079739 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:03:49.079739 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b85ca18b-9b76-43c9-af4d-d7bf77231976 could not be found. Jun 03 10:03:49.079739 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:03:49.080979 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-878287fc-56e4-4c82-ae2d-05edf3c5e21b tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Returning 404 to user: Instance b85ca18b-9b76-43c9-af4d-d7bf77231976 could not be found. {{(pid=117648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:03:49.080979 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-878287fc-56e4-4c82-ae2d-05edf3c5e21b tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/b85ca18b-9b76-43c9-af4d-d7bf77231976" status: 404 len: 111 microversion: 2.1 time: 0.030298 Jun 03 10:03:49.080979 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 398/836] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:49 2022] GET /compute/v2.1/servers/b85ca18b-9b76-43c9-af4d-d7bf77231976 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 10:03:49.086191 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-4713deb5-f4e6-4bb7-a3cb-eb82d1b311f8 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '.version_select at 0x7f5036bd2f70>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:49.103983 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-4713deb5-f4e6-4bb7-a3cb-eb82d1b311f8 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1586986021" status: 202 len: 0 microversion: 2.1 time: 0.021553 Jun 03 10:03:49.104515 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 439/837] 10.222.0.45 () {58 vars in 1220 bytes} [Fri Jun 3 10:03:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1586986021 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 10:03:49.715701 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-bd1b256a-b497-4386-a178-d7a0e3f5bc70 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Action: 'create', calling method: .version_select at 0x7f5036bd3f70>, body: {"keypair": {"name": "tempest-keypair-881499170", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN4sUXTtesc3JARS0kNbAXgbuk0dorvmJgk58/8Yj9hZNKo2eWK8+1FguQoN+s8OMcd3V4XvdkxEzlyXqU16mn5uDWTzYuRp0cKENRAUwA/xRVgODPthxXc2Ds2cdk3bVg=="}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:03:49.729652 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-bd1b256a-b497-4386-a178-d7a0e3f5bc70 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Getting quotas for project 12d4ca628b894615bc311c3705c4a801. Resources: {'key_pairs'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 10:03:49.734897 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-bd1b256a-b497-4386-a178-d7a0e3f5bc70 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Getting quotas for user e62d9d781281497e9927c0eb0e85dd75 and project 12d4ca628b894615bc311c3705c4a801. Resources: {'key_pairs'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 10:03:49.758474 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-bd1b256a-b497-4386-a178-d7a0e3f5bc70 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046569 Jun 03 10:03:49.759062 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 399/838] 10.222.0.45 () {60 vars in 1158 bytes} [Fri Jun 3 10:03:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:03:51.316246 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-63dda114-4f66-47f0-8a0c-302bd7f79e55 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1195006935", "imageRef": "0cb3b007-4e95-448b-8acb-895d8acdb244", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3baa3021-e41d-411e-bddb-b3793d770962"}], "security_groups": [{"name": "tempest-securitygroup--1266808652"}], "key_name": "tempest-keypair-881499170", "user_data": "}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:03:51.424516 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.network.neutron [None req-63dda114-4f66-47f0-8a0c-302bd7f79e55 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] validate_networks() for [('3baa3021-e41d-411e-bddb-b3793d770962', None, None, None, None, None)] {{(pid=117647) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 10:03:51.800875 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-63dda114-4f66-47f0-8a0c-302bd7f79e55 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Flavor limits 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 10:03:51.801261 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-63dda114-4f66-47f0-8a0c-302bd7f79e55 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Image limits 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 10:03:51.801951 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-63dda114-4f66-47f0-8a0c-302bd7f79e55 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Flavor pref 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 10:03:51.802716 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-63dda114-4f66-47f0-8a0c-302bd7f79e55 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Image pref 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 10:03:51.803160 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-63dda114-4f66-47f0-8a0c-302bd7f79e55 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 10:03:51.816951 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-63dda114-4f66-47f0-8a0c-302bd7f79e55 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:51.817098 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-63dda114-4f66-47f0-8a0c-302bd7f79e55 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:51.817823 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-63dda114-4f66-47f0-8a0c-302bd7f79e55 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:51.818264 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-63dda114-4f66-47f0-8a0c-302bd7f79e55 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:51.835048 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-63dda114-4f66-47f0-8a0c-302bd7f79e55 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Getting quotas for project 12d4ca628b894615bc311c3705c4a801. Resources: {'ram', 'cores', 'instances'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 10:03:51.839079 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-63dda114-4f66-47f0-8a0c-302bd7f79e55 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Getting quotas for user e62d9d781281497e9927c0eb0e85dd75 and project 12d4ca628b894615bc311c3705c4a801. Resources: {'ram', 'cores', 'instances'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 10:03:51.850049 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-63dda114-4f66-47f0-8a0c-302bd7f79e55 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Going to run 1 instances... {{(pid=117647) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 10:03:51.852307 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-63dda114-4f66-47f0-8a0c-302bd7f79e55 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: c0b58286-60ef-44eb-8e6b-e8050e695532] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0cb3b007-4e95-448b-8acb-895d8acdb244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 10:03:51.897141 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-63dda114-4f66-47f0-8a0c-302bd7f79e55 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.586396 Jun 03 10:03:51.897989 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 440/839] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jun 3 10:03:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 10:03:51.908178 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-d6654cf1-445c-4138-9496-c7b4ffc3681d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:51.908783 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-d6654cf1-445c-4138-9496-c7b4ffc3681d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: c0b58286-60ef-44eb-8e6b-e8050e695532] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:51.968950 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d6654cf1-445c-4138-9496-c7b4ffc3681d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:51.975552 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-d6654cf1-445c-4138-9496-c7b4ffc3681d tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532" status: 200 len: 1241 microversion: 2.1 time: 0.071718 Jun 03 10:03:51.976107 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 400/840] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:51 2022] GET /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532 => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:52.992901 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-432fc3ac-228b-4cd2-b437-3d8be31fb0c6 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:52.993598 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-432fc3ac-228b-4cd2-b437-3d8be31fb0c6 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: c0b58286-60ef-44eb-8e6b-e8050e695532] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:53.001241 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-432fc3ac-228b-4cd2-b437-3d8be31fb0c6 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:53.002479 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-432fc3ac-228b-4cd2-b437-3d8be31fb0c6 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:53.002681 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-432fc3ac-228b-4cd2-b437-3d8be31fb0c6 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:53.003189 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-432fc3ac-228b-4cd2-b437-3d8be31fb0c6 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:53.070503 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-432fc3ac-228b-4cd2-b437-3d8be31fb0c6 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:53.080501 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-432fc3ac-228b-4cd2-b437-3d8be31fb0c6 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532" status: 200 len: 1301 microversion: 2.1 time: 0.091942 Jun 03 10:03:53.086269 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 441/841] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:52 2022] GET /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532 => generated 1301 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:54.100381 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-8047c55e-31f2-4bea-8ffc-8f8d3e8d4de5 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:54.101006 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-8047c55e-31f2-4bea-8ffc-8f8d3e8d4de5 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: c0b58286-60ef-44eb-8e6b-e8050e695532] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:54.107516 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8047c55e-31f2-4bea-8ffc-8f8d3e8d4de5 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:54.108629 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8047c55e-31f2-4bea-8ffc-8f8d3e8d4de5 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:54.109418 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8047c55e-31f2-4bea-8ffc-8f8d3e8d4de5 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:54.109881 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8047c55e-31f2-4bea-8ffc-8f8d3e8d4de5 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:54.296198 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-8047c55e-31f2-4bea-8ffc-8f8d3e8d4de5 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:54.304736 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-8047c55e-31f2-4bea-8ffc-8f8d3e8d4de5 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532" status: 200 len: 1367 microversion: 2.1 time: 0.209030 Jun 03 10:03:54.316219 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 401/842] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:54 2022] GET /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532 => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:54.722782 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-3a0dacbf-cff4-4625-aceb-3ec0275de767 req-cb7c8688-4e14-4432-8c38-7c6147784e7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0b58286-60ef-44eb-8e6b-e8050e695532", "tag": "14baca63-8bc5-42ac-89bd-e8b6cb1ef01c"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:03:54.736171 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-3a0dacbf-cff4-4625-aceb-3ec0275de767 req-cb7c8688-4e14-4432-8c38-7c6147784e7b service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:54.737047 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-3a0dacbf-cff4-4625-aceb-3ec0275de767 req-cb7c8688-4e14-4432-8c38-7c6147784e7b service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:54.753369 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-3a0dacbf-cff4-4625-aceb-3ec0275de767 req-cb7c8688-4e14-4432-8c38-7c6147784e7b service nova] Creating event network-changed:14baca63-8bc5-42ac-89bd-e8b6cb1ef01c for instance c0b58286-60ef-44eb-8e6b-e8050e695532 on hv-cinder-79760 Jun 03 10:03:54.764731 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-3a0dacbf-cff4-4625-aceb-3ec0275de767 req-cb7c8688-4e14-4432-8c38-7c6147784e7b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042798 Jun 03 10:03:54.765789 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 442/843] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:03:55.323061 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-7887ec25-a5ba-4aef-a624-5af8c4512e0f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:55.323844 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-7887ec25-a5ba-4aef-a624-5af8c4512e0f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: c0b58286-60ef-44eb-8e6b-e8050e695532] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:55.330490 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7887ec25-a5ba-4aef-a624-5af8c4512e0f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:55.330944 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7887ec25-a5ba-4aef-a624-5af8c4512e0f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:55.331715 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7887ec25-a5ba-4aef-a624-5af8c4512e0f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:55.332156 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7887ec25-a5ba-4aef-a624-5af8c4512e0f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:55.470761 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-7887ec25-a5ba-4aef-a624-5af8c4512e0f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:55.478313 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-7887ec25-a5ba-4aef-a624-5af8c4512e0f tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532" status: 200 len: 1367 microversion: 2.1 time: 0.159102 Jun 03 10:03:55.478909 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 402/844] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:55 2022] GET /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:56.496580 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-59835198-1c25-464e-a873-24e28e57c92a tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:56.498324 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-59835198-1c25-464e-a873-24e28e57c92a tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: c0b58286-60ef-44eb-8e6b-e8050e695532] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:56.504923 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-59835198-1c25-464e-a873-24e28e57c92a tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:56.505548 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-59835198-1c25-464e-a873-24e28e57c92a tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:56.506489 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-59835198-1c25-464e-a873-24e28e57c92a tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:56.506947 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-59835198-1c25-464e-a873-24e28e57c92a tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:56.646056 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-59835198-1c25-464e-a873-24e28e57c92a tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:56.656314 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-59835198-1c25-464e-a873-24e28e57c92a tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532" status: 200 len: 1367 microversion: 2.1 time: 0.164475 Jun 03 10:03:56.657283 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 443/845] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:56 2022] GET /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:57.673933 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-6fca43ff-35f8-4024-82d7-4465266d8b22 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:57.674486 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-6fca43ff-35f8-4024-82d7-4465266d8b22 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: c0b58286-60ef-44eb-8e6b-e8050e695532] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:57.681356 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6fca43ff-35f8-4024-82d7-4465266d8b22 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:57.681834 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6fca43ff-35f8-4024-82d7-4465266d8b22 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:57.682600 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6fca43ff-35f8-4024-82d7-4465266d8b22 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:57.683035 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6fca43ff-35f8-4024-82d7-4465266d8b22 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:57.808897 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-6fca43ff-35f8-4024-82d7-4465266d8b22 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:57.816844 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-6fca43ff-35f8-4024-82d7-4465266d8b22 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532" status: 200 len: 1367 microversion: 2.1 time: 0.147344 Jun 03 10:03:57.817409 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 403/846] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:57 2022] GET /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:03:58.640723 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-afe15481-6cb6-42ac-a838-3408cefd491b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:58.641313 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-afe15481-6cb6-42ac-a838-3408cefd491b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:58.648775 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-afe15481-6cb6-42ac-a838-3408cefd491b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:58.649225 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-afe15481-6cb6-42ac-a838-3408cefd491b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:58.650026 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-afe15481-6cb6-42ac-a838-3408cefd491b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:58.650466 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-afe15481-6cb6-42ac-a838-3408cefd491b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:58.675064 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-afe15481-6cb6-42ac-a838-3408cefd491b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898/ips" status: 200 len: 152 microversion: 2.20 time: 0.038752 Jun 03 10:03:58.675633 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 444/847] 10.222.0.45 () {60 vars in 1288 bytes} [Fri Jun 3 10:03:58 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 03 10:03:58.835471 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-92f58cf7-6e81-4934-8427-aa8826e4d052 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:03:58.836098 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-92f58cf7-6e81-4934-8427-aa8826e4d052 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: c0b58286-60ef-44eb-8e6b-e8050e695532] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:03:58.843503 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-92f58cf7-6e81-4934-8427-aa8826e4d052 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:58.843956 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-92f58cf7-6e81-4934-8427-aa8826e4d052 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:58.844749 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-92f58cf7-6e81-4934-8427-aa8826e4d052 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:03:58.845227 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-92f58cf7-6e81-4934-8427-aa8826e4d052 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:03:58.989357 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-92f58cf7-6e81-4934-8427-aa8826e4d052 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:03:58.996928 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-92f58cf7-6e81-4934-8427-aa8826e4d052 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532" status: 200 len: 1367 microversion: 2.1 time: 0.166542 Jun 03 10:03:58.997504 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 404/848] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:03:58 2022] GET /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:00.014064 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-1b0cf677-fe6d-42db-b760-29727ed84412 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:00.014789 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-1b0cf677-fe6d-42db-b760-29727ed84412 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: c0b58286-60ef-44eb-8e6b-e8050e695532] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:00.021556 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1b0cf677-fe6d-42db-b760-29727ed84412 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:00.022068 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1b0cf677-fe6d-42db-b760-29727ed84412 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:00.022893 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1b0cf677-fe6d-42db-b760-29727ed84412 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:00.023331 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1b0cf677-fe6d-42db-b760-29727ed84412 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:00.093651 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-cdaef941-855f-4853-8b0c-95d1df97a853 req-10d51912-92f7-4472-b2ec-f3af705f1dc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0b58286-60ef-44eb-8e6b-e8050e695532", "name": "network-vif-plugged", "status": "completed", "tag": "14baca63-8bc5-42ac-89bd-e8b6cb1ef01c"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:04:00.103695 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-cdaef941-855f-4853-8b0c-95d1df97a853 req-10d51912-92f7-4472-b2ec-f3af705f1dc6 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:00.104787 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-cdaef941-855f-4853-8b0c-95d1df97a853 req-10d51912-92f7-4472-b2ec-f3af705f1dc6 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:00.117166 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-cdaef941-855f-4853-8b0c-95d1df97a853 req-10d51912-92f7-4472-b2ec-f3af705f1dc6 service nova] Creating event network-vif-plugged:14baca63-8bc5-42ac-89bd-e8b6cb1ef01c for instance c0b58286-60ef-44eb-8e6b-e8050e695532 on hv-cinder-79760 Jun 03 10:04:00.122478 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-cdaef941-855f-4853-8b0c-95d1df97a853 req-10d51912-92f7-4472-b2ec-f3af705f1dc6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034595 Jun 03 10:04:00.124118 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 405/849] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:04:00.166447 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-1b0cf677-fe6d-42db-b760-29727ed84412 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:00.175839 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-1b0cf677-fe6d-42db-b760-29727ed84412 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532" status: 200 len: 1367 microversion: 2.1 time: 0.165569 Jun 03 10:04:00.176737 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 445/850] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:00 2022] GET /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:04:01.160684 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-938a2e66-cd1d-4386-8f2d-3bcec557abcc tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:04:01.161559 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-938a2e66-cd1d-4386-8f2d-3bcec557abcc tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:01.168349 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-938a2e66-cd1d-4386-8f2d-3bcec557abcc tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:01.168788 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-938a2e66-cd1d-4386-8f2d-3bcec557abcc tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:01.169547 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-938a2e66-cd1d-4386-8f2d-3bcec557abcc tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:01.170026 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-938a2e66-cd1d-4386-8f2d-3bcec557abcc tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:01.192357 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-f643d908-77b3-4486-8877-2ff774d2915c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:01.192981 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-f643d908-77b3-4486-8877-2ff774d2915c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: c0b58286-60ef-44eb-8e6b-e8050e695532] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:01.196396 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.objects.instance [None req-938a2e66-cd1d-4386-8f2d-3bcec557abcc tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lazy-loading 'flavor' on Instance uuid 02de8459-bf38-485f-971a-d8f1d7909898 {{(pid=117648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:04:01.201455 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f643d908-77b3-4486-8877-2ff774d2915c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:01.201996 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f643d908-77b3-4486-8877-2ff774d2915c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:01.202739 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f643d908-77b3-4486-8877-2ff774d2915c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:01.203188 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f643d908-77b3-4486-8877-2ff774d2915c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:01.354515 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-f643d908-77b3-4486-8877-2ff774d2915c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:01.362373 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-f643d908-77b3-4486-8877-2ff774d2915c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532" status: 200 len: 1367 microversion: 2.1 time: 0.173880 Jun 03 10:04:01.362927 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 446/851] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:01 2022] GET /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:04:01.466105 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-938a2e66-cd1d-4386-8f2d-3bcec557abcc tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "POST /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898/action" status: 202 len: 0 microversion: 2.20 time: 0.309381 Jun 03 10:04:01.466894 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 406/852] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jun 3 10:04:01 2022] POST /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 03 10:04:01.475863 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-c5c0c340-5337-4dcc-9e2c-ebc90bddf029 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:01.476483 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-c5c0c340-5337-4dcc-9e2c-ebc90bddf029 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:01.482638 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c5c0c340-5337-4dcc-9e2c-ebc90bddf029 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:01.484117 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c5c0c340-5337-4dcc-9e2c-ebc90bddf029 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:01.484868 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c5c0c340-5337-4dcc-9e2c-ebc90bddf029 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:01.485409 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c5c0c340-5337-4dcc-9e2c-ebc90bddf029 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:01.501015 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:04:01.622796 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-c5c0c340-5337-4dcc-9e2c-ebc90bddf029 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:01.632000 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-c5c0c340-5337-4dcc-9e2c-ebc90bddf029 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:01.633619 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-c5c0c340-5337-4dcc-9e2c-ebc90bddf029 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:01.634909 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-c5c0c340-5337-4dcc-9e2c-ebc90bddf029 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1724 microversion: 2.20 time: 0.163297 Jun 03 10:04:01.637327 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 447/853] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:01 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:02.379615 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-4e8d139f-31d5-43ce-9170-e6314540b864 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:02.381098 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-4e8d139f-31d5-43ce-9170-e6314540b864 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: c0b58286-60ef-44eb-8e6b-e8050e695532] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:02.383268 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell0:SELECT=6 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:04:02.390012 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4e8d139f-31d5-43ce-9170-e6314540b864 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:02.390415 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4e8d139f-31d5-43ce-9170-e6314540b864 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:02.391357 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4e8d139f-31d5-43ce-9170-e6314540b864 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:02.391801 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4e8d139f-31d5-43ce-9170-e6314540b864 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:02.522144 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-4e8d139f-31d5-43ce-9170-e6314540b864 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:02.530155 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-4e8d139f-31d5-43ce-9170-e6314540b864 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532" status: 200 len: 1558 microversion: 2.1 time: 0.154016 Jun 03 10:04:02.530715 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 407/854] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:02 2022] GET /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:02.546429 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-5d5c86be-f10b-476d-ae69-74d4311134e5 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:02.546921 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-5d5c86be-f10b-476d-ae69-74d4311134e5 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: c0b58286-60ef-44eb-8e6b-e8050e695532] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:02.548754 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell0:SELECT=2 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:04:02.549537 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell0:SELECT=6 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:04:02.556001 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5d5c86be-f10b-476d-ae69-74d4311134e5 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:02.556453 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5d5c86be-f10b-476d-ae69-74d4311134e5 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:02.557230 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5d5c86be-f10b-476d-ae69-74d4311134e5 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:02.557672 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5d5c86be-f10b-476d-ae69-74d4311134e5 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:02.638741 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-5d5c86be-f10b-476d-ae69-74d4311134e5 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096228 Jun 03 10:04:02.639894 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 448/855] 10.222.0.45 () {58 vars in 1274 bytes} [Fri Jun 3 10:04:02 2022] GET /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:04:02.655340 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-c6c74987-ee6f-4ea1-a096-52db95070d90 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:02.656227 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-c6c74987-ee6f-4ea1-a096-52db95070d90 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:02.662660 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c6c74987-ee6f-4ea1-a096-52db95070d90 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:02.663192 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c6c74987-ee6f-4ea1-a096-52db95070d90 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:02.664042 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c6c74987-ee6f-4ea1-a096-52db95070d90 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:02.664556 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c6c74987-ee6f-4ea1-a096-52db95070d90 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:02.951237 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-c6c74987-ee6f-4ea1-a096-52db95070d90 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:02.955927 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:04:02.962450 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-c6c74987-ee6f-4ea1-a096-52db95070d90 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:02.964002 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-c6c74987-ee6f-4ea1-a096-52db95070d90 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:02.965179 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-c6c74987-ee6f-4ea1-a096-52db95070d90 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1724 microversion: 2.20 time: 0.314301 Jun 03 10:04:02.965765 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 408/856] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:02 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1724 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:03.640162 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-f1dfb6b1-5d88-402b-9d68-3c9a039eede1 req-acf21d81-7b72-4ac5-a69c-24205f1394a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0b58286-60ef-44eb-8e6b-e8050e695532", "tag": "14baca63-8bc5-42ac-89bd-e8b6cb1ef01c"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:04:03.648309 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-f1dfb6b1-5d88-402b-9d68-3c9a039eede1 req-acf21d81-7b72-4ac5-a69c-24205f1394a6 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:03.648685 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-f1dfb6b1-5d88-402b-9d68-3c9a039eede1 req-acf21d81-7b72-4ac5-a69c-24205f1394a6 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:03.659776 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-f1dfb6b1-5d88-402b-9d68-3c9a039eede1 req-acf21d81-7b72-4ac5-a69c-24205f1394a6 service nova] Creating event network-changed:14baca63-8bc5-42ac-89bd-e8b6cb1ef01c for instance c0b58286-60ef-44eb-8e6b-e8050e695532 on hv-cinder-79760 Jun 03 10:04:03.664944 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-f1dfb6b1-5d88-402b-9d68-3c9a039eede1 req-acf21d81-7b72-4ac5-a69c-24205f1394a6 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029541 Jun 03 10:04:03.665520 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 449/857] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:04:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:04:03.984808 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-343ad2bc-4422-48de-b2b4-c10056ea833e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:03.985434 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-343ad2bc-4422-48de-b2b4-c10056ea833e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:03.992876 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-343ad2bc-4422-48de-b2b4-c10056ea833e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:03.993333 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-343ad2bc-4422-48de-b2b4-c10056ea833e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:03.994152 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-343ad2bc-4422-48de-b2b4-c10056ea833e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:03.994592 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-343ad2bc-4422-48de-b2b4-c10056ea833e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:04.142406 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-343ad2bc-4422-48de-b2b4-c10056ea833e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:04.151028 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-343ad2bc-4422-48de-b2b4-c10056ea833e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:04.152777 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-343ad2bc-4422-48de-b2b4-c10056ea833e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:04.154260 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-343ad2bc-4422-48de-b2b4-c10056ea833e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1724 microversion: 2.20 time: 0.174675 Jun 03 10:04:04.155344 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 409/858] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:03 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:05.173403 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-a47eddba-02df-469d-9470-2634138bc59c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:05.174196 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-a47eddba-02df-469d-9470-2634138bc59c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:05.180650 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a47eddba-02df-469d-9470-2634138bc59c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:05.181094 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a47eddba-02df-469d-9470-2634138bc59c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:05.181911 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a47eddba-02df-469d-9470-2634138bc59c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:05.182351 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a47eddba-02df-469d-9470-2634138bc59c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:05.313513 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-a47eddba-02df-469d-9470-2634138bc59c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:05.323299 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-a47eddba-02df-469d-9470-2634138bc59c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:05.324811 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-a47eddba-02df-469d-9470-2634138bc59c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:05.326106 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-a47eddba-02df-469d-9470-2634138bc59c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1724 microversion: 2.20 time: 0.157302 Jun 03 10:04:05.327324 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 450/859] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:05 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:06.344987 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-1e8de1fe-a87e-491d-8324-26a093dc287b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:06.345575 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-1e8de1fe-a87e-491d-8324-26a093dc287b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:06.352098 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1e8de1fe-a87e-491d-8324-26a093dc287b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:06.352546 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1e8de1fe-a87e-491d-8324-26a093dc287b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:06.353301 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1e8de1fe-a87e-491d-8324-26a093dc287b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:06.353731 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1e8de1fe-a87e-491d-8324-26a093dc287b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:06.491333 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-1e8de1fe-a87e-491d-8324-26a093dc287b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:06.500130 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-1e8de1fe-a87e-491d-8324-26a093dc287b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:06.501649 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-1e8de1fe-a87e-491d-8324-26a093dc287b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:06.502901 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-1e8de1fe-a87e-491d-8324-26a093dc287b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1724 microversion: 2.20 time: 0.162274 Jun 03 10:04:06.503457 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 410/860] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:06 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:07.521537 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-950f421d-4cdd-4941-a605-87747f989944 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:07.522298 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-950f421d-4cdd-4941-a605-87747f989944 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:07.529237 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-950f421d-4cdd-4941-a605-87747f989944 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:07.529689 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-950f421d-4cdd-4941-a605-87747f989944 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:07.530568 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-950f421d-4cdd-4941-a605-87747f989944 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:07.531021 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-950f421d-4cdd-4941-a605-87747f989944 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:07.665283 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-950f421d-4cdd-4941-a605-87747f989944 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:07.673821 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-950f421d-4cdd-4941-a605-87747f989944 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:07.675335 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-950f421d-4cdd-4941-a605-87747f989944 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:07.676572 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-950f421d-4cdd-4941-a605-87747f989944 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1724 microversion: 2.20 time: 0.158840 Jun 03 10:04:07.677071 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 451/861] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:07 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:08.694252 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-ede602a9-6dd0-4829-a336-008bb277d03f tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:08.694853 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-ede602a9-6dd0-4829-a336-008bb277d03f tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:08.701008 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ede602a9-6dd0-4829-a336-008bb277d03f tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:08.702263 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ede602a9-6dd0-4829-a336-008bb277d03f tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:08.703037 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ede602a9-6dd0-4829-a336-008bb277d03f tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:08.703493 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ede602a9-6dd0-4829-a336-008bb277d03f tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:08.850527 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-ede602a9-6dd0-4829-a336-008bb277d03f tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:08.860622 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-ede602a9-6dd0-4829-a336-008bb277d03f tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:08.862392 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-ede602a9-6dd0-4829-a336-008bb277d03f tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:08.863858 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-ede602a9-6dd0-4829-a336-008bb277d03f tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1724 microversion: 2.20 time: 0.173364 Jun 03 10:04:08.864733 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 411/862] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:08 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:09.883502 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-ffae482e-9406-42e2-bcac-fbe2d2f7f59b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:09.884145 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-ffae482e-9406-42e2-bcac-fbe2d2f7f59b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:09.890696 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ffae482e-9406-42e2-bcac-fbe2d2f7f59b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:09.891149 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ffae482e-9406-42e2-bcac-fbe2d2f7f59b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:09.891949 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ffae482e-9406-42e2-bcac-fbe2d2f7f59b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:09.892406 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ffae482e-9406-42e2-bcac-fbe2d2f7f59b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:09.989248 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-66598e2a-da99-4f9b-abe0-e00ed74ce38b tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1698983741", "imageRef": "0cb3b007-4e95-448b-8acb-895d8acdb244", "flavorRef": "452", "networks": [{"uuid": "bfa85722-84cb-4296-8162-976137487800"}]}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:04:10.027265 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-ffae482e-9406-42e2-bcac-fbe2d2f7f59b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:10.035765 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-ffae482e-9406-42e2-bcac-fbe2d2f7f59b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:10.037538 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-ffae482e-9406-42e2-bcac-fbe2d2f7f59b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:10.038849 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-ffae482e-9406-42e2-bcac-fbe2d2f7f59b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1724 microversion: 2.20 time: 0.159325 Jun 03 10:04:10.039446 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 452/863] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:09 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:10.041362 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.network.neutron [None req-66598e2a-da99-4f9b-abe0-e00ed74ce38b tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] validate_networks() for [('bfa85722-84cb-4296-8162-976137487800', None, None, None, None, None)] {{(pid=117648) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 10:04:10.376191 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-66598e2a-da99-4f9b-abe0-e00ed74ce38b tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Flavor limits 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 10:04:10.376612 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-66598e2a-da99-4f9b-abe0-e00ed74ce38b tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Image limits 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 10:04:10.377083 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-66598e2a-da99-4f9b-abe0-e00ed74ce38b tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Flavor pref 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 10:04:10.377516 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-66598e2a-da99-4f9b-abe0-e00ed74ce38b tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Image pref 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 10:04:10.377959 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-66598e2a-da99-4f9b-abe0-e00ed74ce38b tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 10:04:10.386851 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-66598e2a-da99-4f9b-abe0-e00ed74ce38b tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:10.387293 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-66598e2a-da99-4f9b-abe0-e00ed74ce38b tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:10.388083 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-66598e2a-da99-4f9b-abe0-e00ed74ce38b tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:10.388518 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-66598e2a-da99-4f9b-abe0-e00ed74ce38b tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:10.406753 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-66598e2a-da99-4f9b-abe0-e00ed74ce38b tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Getting quotas for project 0ddc37afc4d54ccab945af619507a613. Resources: {'ram', 'cores', 'instances'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 10:04:10.410620 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-66598e2a-da99-4f9b-abe0-e00ed74ce38b tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Getting quotas for user 1d75851094d145f4907c7049d78dafed and project 0ddc37afc4d54ccab945af619507a613. Resources: {'ram', 'cores', 'instances'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 10:04:10.422197 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-66598e2a-da99-4f9b-abe0-e00ed74ce38b tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Going to run 1 instances... {{(pid=117648) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 10:04:10.424429 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-66598e2a-da99-4f9b-abe0-e00ed74ce38b tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] [instance: e742fa97-215c-48de-bc9b-d7c3b17c6cb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0cb3b007-4e95-448b-8acb-895d8acdb244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 10:04:10.471700 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-66598e2a-da99-4f9b-abe0-e00ed74ce38b tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.486175 Jun 03 10:04:10.472344 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 412/864] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jun 3 10:04:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 487 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 03 10:04:10.482135 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-ceb00d13-ec09-466c-8db8-c894cb41cb50 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:10.483299 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-ceb00d13-ec09-466c-8db8-c894cb41cb50 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] [instance: e742fa97-215c-48de-bc9b-d7c3b17c6cb0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:10.538990 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-ceb00d13-ec09-466c-8db8-c894cb41cb50 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d75851094d145f4907c7049d78dafed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddc37afc4d54ccab945af619507a613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:10.547868 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-ceb00d13-ec09-466c-8db8-c894cb41cb50 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] 10.222.0.45 "GET /compute/v2.1/servers/e742fa97-215c-48de-bc9b-d7c3b17c6cb0" status: 200 len: 1219 microversion: 2.1 time: 0.069489 Jun 03 10:04:10.548437 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 453/865] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:10 2022] GET /compute/v2.1/servers/e742fa97-215c-48de-bc9b-d7c3b17c6cb0 => generated 1219 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:11.058561 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-be1ed3ef-f370-4f38-9cab-a86ad3c30ff5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:11.059180 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-be1ed3ef-f370-4f38-9cab-a86ad3c30ff5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:11.066408 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-be1ed3ef-f370-4f38-9cab-a86ad3c30ff5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:11.066862 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-be1ed3ef-f370-4f38-9cab-a86ad3c30ff5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:11.067644 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-be1ed3ef-f370-4f38-9cab-a86ad3c30ff5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:11.068089 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-be1ed3ef-f370-4f38-9cab-a86ad3c30ff5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:11.204756 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-be1ed3ef-f370-4f38-9cab-a86ad3c30ff5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:11.212920 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-be1ed3ef-f370-4f38-9cab-a86ad3c30ff5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:11.214458 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-be1ed3ef-f370-4f38-9cab-a86ad3c30ff5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:11.215617 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-be1ed3ef-f370-4f38-9cab-a86ad3c30ff5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1724 microversion: 2.20 time: 0.161494 Jun 03 10:04:11.216169 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 413/866] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:11 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:11.565038 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-72f76792-2930-4d73-90ce-94a777ec2746 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:11.566281 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-72f76792-2930-4d73-90ce-94a777ec2746 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] [instance: e742fa97-215c-48de-bc9b-d7c3b17c6cb0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:11.575207 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-72f76792-2930-4d73-90ce-94a777ec2746 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:11.575207 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-72f76792-2930-4d73-90ce-94a777ec2746 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:11.575207 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-72f76792-2930-4d73-90ce-94a777ec2746 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:11.575590 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-72f76792-2930-4d73-90ce-94a777ec2746 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:11.649278 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-72f76792-2930-4d73-90ce-94a777ec2746 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d75851094d145f4907c7049d78dafed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddc37afc4d54ccab945af619507a613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:11.656716 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-72f76792-2930-4d73-90ce-94a777ec2746 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] 10.222.0.45 "GET /compute/v2.1/servers/e742fa97-215c-48de-bc9b-d7c3b17c6cb0" status: 200 len: 1279 microversion: 2.1 time: 0.096138 Jun 03 10:04:11.657273 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 454/867] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:11 2022] GET /compute/v2.1/servers/e742fa97-215c-48de-bc9b-d7c3b17c6cb0 => generated 1279 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:12.233933 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-d74370ef-2722-4203-b16d-f7acc01588be tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:12.234600 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-d74370ef-2722-4203-b16d-f7acc01588be tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:12.241622 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d74370ef-2722-4203-b16d-f7acc01588be tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:12.242144 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d74370ef-2722-4203-b16d-f7acc01588be tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:12.242916 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d74370ef-2722-4203-b16d-f7acc01588be tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:12.243355 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d74370ef-2722-4203-b16d-f7acc01588be tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:12.380422 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d74370ef-2722-4203-b16d-f7acc01588be tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:12.389132 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d74370ef-2722-4203-b16d-f7acc01588be tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:12.390790 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d74370ef-2722-4203-b16d-f7acc01588be tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:12.392123 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-d74370ef-2722-4203-b16d-f7acc01588be tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1724 microversion: 2.20 time: 0.162318 Jun 03 10:04:12.393095 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 414/868] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:12 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:12.673819 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-21e57490-d28a-4f08-a0f5-345632ca220f tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:12.674439 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-21e57490-d28a-4f08-a0f5-345632ca220f tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] [instance: e742fa97-215c-48de-bc9b-d7c3b17c6cb0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:12.681067 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-21e57490-d28a-4f08-a0f5-345632ca220f tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:12.681524 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-21e57490-d28a-4f08-a0f5-345632ca220f tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:12.682331 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-21e57490-d28a-4f08-a0f5-345632ca220f tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:12.683302 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-21e57490-d28a-4f08-a0f5-345632ca220f tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:12.813251 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-21e57490-d28a-4f08-a0f5-345632ca220f tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d75851094d145f4907c7049d78dafed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddc37afc4d54ccab945af619507a613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:12.820755 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-21e57490-d28a-4f08-a0f5-345632ca220f tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] 10.222.0.45 "GET /compute/v2.1/servers/e742fa97-215c-48de-bc9b-d7c3b17c6cb0" status: 200 len: 1319 microversion: 2.1 time: 0.150813 Jun 03 10:04:12.821329 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 455/869] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:12 2022] GET /compute/v2.1/servers/e742fa97-215c-48de-bc9b-d7c3b17c6cb0 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:12.891815 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-5cb3ff01-865b-402d-b49a-1de401e4c990 req-acd4410c-7d5b-431e-af11-019dfc79d874 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e742fa97-215c-48de-bc9b-d7c3b17c6cb0", "tag": "c2b91a1c-f9d4-44f5-a66a-8c0b3cf2602d"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:04:12.897251 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:04:12.904284 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-5cb3ff01-865b-402d-b49a-1de401e4c990 req-acd4410c-7d5b-431e-af11-019dfc79d874 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:12.905851 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-5cb3ff01-865b-402d-b49a-1de401e4c990 req-acd4410c-7d5b-431e-af11-019dfc79d874 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:12.921017 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-5cb3ff01-865b-402d-b49a-1de401e4c990 req-acd4410c-7d5b-431e-af11-019dfc79d874 service nova] Creating event network-changed:c2b91a1c-f9d4-44f5-a66a-8c0b3cf2602d for instance e742fa97-215c-48de-bc9b-d7c3b17c6cb0 on hv-cinder-79760 Jun 03 10:04:12.925828 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-5cb3ff01-865b-402d-b49a-1de401e4c990 req-acd4410c-7d5b-431e-af11-019dfc79d874 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037980 Jun 03 10:04:12.926437 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 415/870] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 10:04:13.411430 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-77295823-934a-497c-b281-c14310a1b326 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:13.412068 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-77295823-934a-497c-b281-c14310a1b326 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:13.418153 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-77295823-934a-497c-b281-c14310a1b326 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:13.418607 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-77295823-934a-497c-b281-c14310a1b326 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:13.419364 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-77295823-934a-497c-b281-c14310a1b326 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:13.419801 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-77295823-934a-497c-b281-c14310a1b326 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:13.549133 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-77295823-934a-497c-b281-c14310a1b326 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:13.557349 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-77295823-934a-497c-b281-c14310a1b326 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:13.558902 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-77295823-934a-497c-b281-c14310a1b326 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:13.560069 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-77295823-934a-497c-b281-c14310a1b326 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1724 microversion: 2.20 time: 0.152886 Jun 03 10:04:13.560635 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 456/871] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:13 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:13.838479 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-f6967f5a-9b6d-4051-8a3e-d8dabc47ef41 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:13.839181 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-f6967f5a-9b6d-4051-8a3e-d8dabc47ef41 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] [instance: e742fa97-215c-48de-bc9b-d7c3b17c6cb0] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:13.845329 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f6967f5a-9b6d-4051-8a3e-d8dabc47ef41 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:13.845867 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f6967f5a-9b6d-4051-8a3e-d8dabc47ef41 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:13.846635 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f6967f5a-9b6d-4051-8a3e-d8dabc47ef41 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:13.847073 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f6967f5a-9b6d-4051-8a3e-d8dabc47ef41 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:13.974020 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f6967f5a-9b6d-4051-8a3e-d8dabc47ef41 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d75851094d145f4907c7049d78dafed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddc37afc4d54ccab945af619507a613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:13.981649 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-f6967f5a-9b6d-4051-8a3e-d8dabc47ef41 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] 10.222.0.45 "GET /compute/v2.1/servers/e742fa97-215c-48de-bc9b-d7c3b17c6cb0" status: 200 len: 1319 microversion: 2.1 time: 0.147612 Jun 03 10:04:13.982263 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 416/872] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:13 2022] GET /compute/v2.1/servers/e742fa97-215c-48de-bc9b-d7c3b17c6cb0 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:14.578326 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-95281a7e-c4d4-4eaa-9db9-45705c2dd5d7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:14.579055 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-95281a7e-c4d4-4eaa-9db9-45705c2dd5d7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:14.581499 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:04:14.587393 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-95281a7e-c4d4-4eaa-9db9-45705c2dd5d7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:14.587853 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-95281a7e-c4d4-4eaa-9db9-45705c2dd5d7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:14.588657 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-95281a7e-c4d4-4eaa-9db9-45705c2dd5d7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:14.589119 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-95281a7e-c4d4-4eaa-9db9-45705c2dd5d7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:14.720898 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-95281a7e-c4d4-4eaa-9db9-45705c2dd5d7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:14.728946 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-95281a7e-c4d4-4eaa-9db9-45705c2dd5d7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:14.730492 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-95281a7e-c4d4-4eaa-9db9-45705c2dd5d7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:14.731697 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-95281a7e-c4d4-4eaa-9db9-45705c2dd5d7 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1724 microversion: 2.20 time: 0.157906 Jun 03 10:04:14.732253 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 457/873] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:14 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:14.998846 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-8f0c7c84-50de-492f-9e60-4c63d1a90e38 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:14.999471 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-8f0c7c84-50de-492f-9e60-4c63d1a90e38 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] [instance: e742fa97-215c-48de-bc9b-d7c3b17c6cb0] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:15.006089 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8f0c7c84-50de-492f-9e60-4c63d1a90e38 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:15.006550 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8f0c7c84-50de-492f-9e60-4c63d1a90e38 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:15.007322 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8f0c7c84-50de-492f-9e60-4c63d1a90e38 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:15.007763 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8f0c7c84-50de-492f-9e60-4c63d1a90e38 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:15.134989 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-8f0c7c84-50de-492f-9e60-4c63d1a90e38 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d75851094d145f4907c7049d78dafed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddc37afc4d54ccab945af619507a613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:15.142916 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-8f0c7c84-50de-492f-9e60-4c63d1a90e38 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] 10.222.0.45 "GET /compute/v2.1/servers/e742fa97-215c-48de-bc9b-d7c3b17c6cb0" status: 200 len: 1319 microversion: 2.1 time: 0.148093 Jun 03 10:04:15.143480 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 417/874] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:14 2022] GET /compute/v2.1/servers/e742fa97-215c-48de-bc9b-d7c3b17c6cb0 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:15.750379 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-721adef1-04df-486c-8ff3-5f2d2d966b3c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:15.751022 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-721adef1-04df-486c-8ff3-5f2d2d966b3c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:15.757538 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-721adef1-04df-486c-8ff3-5f2d2d966b3c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:15.758014 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-721adef1-04df-486c-8ff3-5f2d2d966b3c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:15.758771 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-721adef1-04df-486c-8ff3-5f2d2d966b3c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:15.759212 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-721adef1-04df-486c-8ff3-5f2d2d966b3c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:15.892124 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-721adef1-04df-486c-8ff3-5f2d2d966b3c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:15.900029 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-721adef1-04df-486c-8ff3-5f2d2d966b3c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:15.901557 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-721adef1-04df-486c-8ff3-5f2d2d966b3c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:15.902741 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-721adef1-04df-486c-8ff3-5f2d2d966b3c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1724 microversion: 2.20 time: 0.156842 Jun 03 10:04:15.903305 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 458/875] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:15 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:16.159233 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-fabd6eda-c55c-4eed-9093-ec9ecc8f9f3a tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:16.159878 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-fabd6eda-c55c-4eed-9093-ec9ecc8f9f3a tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] [instance: e742fa97-215c-48de-bc9b-d7c3b17c6cb0] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:16.166633 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fabd6eda-c55c-4eed-9093-ec9ecc8f9f3a tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:16.167092 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fabd6eda-c55c-4eed-9093-ec9ecc8f9f3a tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:16.167861 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fabd6eda-c55c-4eed-9093-ec9ecc8f9f3a tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:16.168295 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fabd6eda-c55c-4eed-9093-ec9ecc8f9f3a tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:16.316778 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-fabd6eda-c55c-4eed-9093-ec9ecc8f9f3a tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d75851094d145f4907c7049d78dafed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddc37afc4d54ccab945af619507a613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:16.324666 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-fabd6eda-c55c-4eed-9093-ec9ecc8f9f3a tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] 10.222.0.45 "GET /compute/v2.1/servers/e742fa97-215c-48de-bc9b-d7c3b17c6cb0" status: 200 len: 1319 microversion: 2.1 time: 0.169300 Jun 03 10:04:16.325260 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 418/876] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:16 2022] GET /compute/v2.1/servers/e742fa97-215c-48de-bc9b-d7c3b17c6cb0 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:16.827441 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-5b73db99-581d-459b-96c2-552d9bc8505e tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:04:16.827988 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-5b73db99-581d-459b-96c2-552d9bc8505e tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:16.834472 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5b73db99-581d-459b-96c2-552d9bc8505e tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:16.834922 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5b73db99-581d-459b-96c2-552d9bc8505e tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:16.835682 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5b73db99-581d-459b-96c2-552d9bc8505e tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:16.836120 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5b73db99-581d-459b-96c2-552d9bc8505e tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:16.857948 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.objects.instance [None req-5b73db99-581d-459b-96c2-552d9bc8505e tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lazy-loading 'flavor' on Instance uuid 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 {{(pid=117647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:04:16.922550 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-5590c027-3b5c-433a-846a-9de9ba7ee795 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:16.923085 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-5590c027-3b5c-433a-846a-9de9ba7ee795 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:16.929610 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5590c027-3b5c-433a-846a-9de9ba7ee795 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:16.930095 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5590c027-3b5c-433a-846a-9de9ba7ee795 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:16.930928 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5590c027-3b5c-433a-846a-9de9ba7ee795 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:16.931304 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-5b73db99-581d-459b-96c2-552d9bc8505e tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "POST /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10/action" status: 202 len: 0 microversion: 2.1 time: 0.108164 Jun 03 10:04:16.931473 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5590c027-3b5c-433a-846a-9de9ba7ee795 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:16.931915 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 459/877] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jun 3 10:04:16 2022] POST /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 10:04:16.940824 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-2856633b-7932-4b72-a8c4-f6b9274fb81b tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:16.941540 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-2856633b-7932-4b72-a8c4-f6b9274fb81b tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:16.947924 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2856633b-7932-4b72-a8c4-f6b9274fb81b tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:16.948376 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2856633b-7932-4b72-a8c4-f6b9274fb81b tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:16.949181 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2856633b-7932-4b72-a8c4-f6b9274fb81b tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:16.949596 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2856633b-7932-4b72-a8c4-f6b9274fb81b tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:17.135131 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-5590c027-3b5c-433a-846a-9de9ba7ee795 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:17.143712 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-5590c027-3b5c-433a-846a-9de9ba7ee795 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:17.144049 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-2856633b-7932-4b72-a8c4-f6b9274fb81b tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:17.145241 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-5590c027-3b5c-433a-846a-9de9ba7ee795 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:17.146431 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-5590c027-3b5c-433a-846a-9de9ba7ee795 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1724 microversion: 2.20 time: 0.228286 Jun 03 10:04:17.146991 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 419/878] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:16 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1724 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 10:04:17.151869 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-2856633b-7932-4b72-a8c4-f6b9274fb81b tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1570 microversion: 2.1 time: 0.214978 Jun 03 10:04:17.152516 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 460/879] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:16 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1570 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:04:17.341716 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-d535826b-1b14-4091-bd2b-52e45b1e1e24 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:17.342377 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-d535826b-1b14-4091-bd2b-52e45b1e1e24 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] [instance: e742fa97-215c-48de-bc9b-d7c3b17c6cb0] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:17.348830 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d535826b-1b14-4091-bd2b-52e45b1e1e24 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:17.349273 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d535826b-1b14-4091-bd2b-52e45b1e1e24 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:17.350051 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d535826b-1b14-4091-bd2b-52e45b1e1e24 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:17.350480 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d535826b-1b14-4091-bd2b-52e45b1e1e24 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:17.477928 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d535826b-1b14-4091-bd2b-52e45b1e1e24 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d75851094d145f4907c7049d78dafed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddc37afc4d54ccab945af619507a613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:17.485788 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-d535826b-1b14-4091-bd2b-52e45b1e1e24 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] 10.222.0.45 "GET /compute/v2.1/servers/e742fa97-215c-48de-bc9b-d7c3b17c6cb0" status: 200 len: 1319 microversion: 2.1 time: 0.147856 Jun 03 10:04:17.486359 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 420/880] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:17 2022] GET /compute/v2.1/servers/e742fa97-215c-48de-bc9b-d7c3b17c6cb0 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:18.164954 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-9d82d268-3c7a-4d51-a3bb-c75fee79edf5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:18.165588 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-9d82d268-3c7a-4d51-a3bb-c75fee79edf5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:18.169657 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-345989ba-c25d-46aa-901d-1476ee2d9a67 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:18.170391 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-345989ba-c25d-46aa-901d-1476ee2d9a67 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:18.172398 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9d82d268-3c7a-4d51-a3bb-c75fee79edf5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:18.173687 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9d82d268-3c7a-4d51-a3bb-c75fee79edf5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:18.174245 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9d82d268-3c7a-4d51-a3bb-c75fee79edf5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:18.174684 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9d82d268-3c7a-4d51-a3bb-c75fee79edf5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:18.176951 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-345989ba-c25d-46aa-901d-1476ee2d9a67 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:18.177516 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-345989ba-c25d-46aa-901d-1476ee2d9a67 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:18.178386 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-345989ba-c25d-46aa-901d-1476ee2d9a67 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:18.178910 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-345989ba-c25d-46aa-901d-1476ee2d9a67 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:18.375710 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-9d82d268-3c7a-4d51-a3bb-c75fee79edf5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:18.379426 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-345989ba-c25d-46aa-901d-1476ee2d9a67 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:18.384121 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-9d82d268-3c7a-4d51-a3bb-c75fee79edf5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:18.385614 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-9d82d268-3c7a-4d51-a3bb-c75fee79edf5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:18.386822 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-9d82d268-3c7a-4d51-a3bb-c75fee79edf5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1724 microversion: 2.20 time: 0.226346 Jun 03 10:04:18.386959 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-345989ba-c25d-46aa-901d-1476ee2d9a67 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1570 microversion: 2.1 time: 0.221248 Jun 03 10:04:18.387622 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 461/881] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:18 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:18.392407 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-ae9d368c-2b0f-4a95-a246-d28585dbf2d5 req-2fc17d62-7111-41a1-aace-54e5a2627e7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e742fa97-215c-48de-bc9b-d7c3b17c6cb0", "name": "network-vif-plugged", "status": "completed", "tag": "c2b91a1c-f9d4-44f5-a66a-8c0b3cf2602d"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:04:18.405147 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 421/882] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:18 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1570 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:04:18.405333 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-ae9d368c-2b0f-4a95-a246-d28585dbf2d5 req-2fc17d62-7111-41a1-aace-54e5a2627e7f service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:18.405333 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-ae9d368c-2b0f-4a95-a246-d28585dbf2d5 req-2fc17d62-7111-41a1-aace-54e5a2627e7f service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:18.412433 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-ae9d368c-2b0f-4a95-a246-d28585dbf2d5 req-2fc17d62-7111-41a1-aace-54e5a2627e7f service nova] Creating event network-vif-plugged:c2b91a1c-f9d4-44f5-a66a-8c0b3cf2602d for instance e742fa97-215c-48de-bc9b-d7c3b17c6cb0 on hv-cinder-79760 Jun 03 10:04:18.417376 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-ae9d368c-2b0f-4a95-a246-d28585dbf2d5 req-2fc17d62-7111-41a1-aace-54e5a2627e7f service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028782 Jun 03 10:04:18.417987 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 462/883] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:04:18.502771 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-52d59310-9a14-43df-ab25-0d2520b0bcf6 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:18.503394 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-52d59310-9a14-43df-ab25-0d2520b0bcf6 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] [instance: e742fa97-215c-48de-bc9b-d7c3b17c6cb0] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:18.509354 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-52d59310-9a14-43df-ab25-0d2520b0bcf6 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:18.509839 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-52d59310-9a14-43df-ab25-0d2520b0bcf6 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:18.510607 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-52d59310-9a14-43df-ab25-0d2520b0bcf6 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:18.511134 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-52d59310-9a14-43df-ab25-0d2520b0bcf6 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:18.648057 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-52d59310-9a14-43df-ab25-0d2520b0bcf6 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d75851094d145f4907c7049d78dafed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddc37afc4d54ccab945af619507a613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:18.655702 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-52d59310-9a14-43df-ab25-0d2520b0bcf6 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] 10.222.0.45 "GET /compute/v2.1/servers/e742fa97-215c-48de-bc9b-d7c3b17c6cb0" status: 200 len: 1319 microversion: 2.1 time: 0.156788 Jun 03 10:04:18.656259 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 422/884] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:18 2022] GET /compute/v2.1/servers/e742fa97-215c-48de-bc9b-d7c3b17c6cb0 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:19.405827 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-0d6db2bf-2eda-4063-9400-387d5e6bea81 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:19.406535 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-0d6db2bf-2eda-4063-9400-387d5e6bea81 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:19.412293 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-f9412e0e-d2f4-4b67-b8d1-35ece15f7b24 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:19.412916 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-f9412e0e-d2f4-4b67-b8d1-35ece15f7b24 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:19.413245 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0d6db2bf-2eda-4063-9400-387d5e6bea81 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:19.413696 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0d6db2bf-2eda-4063-9400-387d5e6bea81 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:19.414562 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0d6db2bf-2eda-4063-9400-387d5e6bea81 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:19.415002 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0d6db2bf-2eda-4063-9400-387d5e6bea81 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:19.419593 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f9412e0e-d2f4-4b67-b8d1-35ece15f7b24 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:19.420087 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f9412e0e-d2f4-4b67-b8d1-35ece15f7b24 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:19.420854 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f9412e0e-d2f4-4b67-b8d1-35ece15f7b24 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:19.421295 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f9412e0e-d2f4-4b67-b8d1-35ece15f7b24 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:19.611254 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f9412e0e-d2f4-4b67-b8d1-35ece15f7b24 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:19.615535 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-0d6db2bf-2eda-4063-9400-387d5e6bea81 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:19.619316 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-f9412e0e-d2f4-4b67-b8d1-35ece15f7b24 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1570 microversion: 2.1 time: 0.210990 Jun 03 10:04:19.619894 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 423/885] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:19 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1570 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:04:19.624005 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-0d6db2bf-2eda-4063-9400-387d5e6bea81 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:19.625514 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-0d6db2bf-2eda-4063-9400-387d5e6bea81 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:19.626722 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-0d6db2bf-2eda-4063-9400-387d5e6bea81 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1724 microversion: 2.20 time: 0.226057 Jun 03 10:04:19.627268 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 463/886] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:19 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:19.672065 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-d653ecb8-58ae-40a9-abff-938d52253dd5 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:19.672629 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-d653ecb8-58ae-40a9-abff-938d52253dd5 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] [instance: e742fa97-215c-48de-bc9b-d7c3b17c6cb0] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:19.678654 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d653ecb8-58ae-40a9-abff-938d52253dd5 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:19.679077 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d653ecb8-58ae-40a9-abff-938d52253dd5 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:19.679834 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d653ecb8-58ae-40a9-abff-938d52253dd5 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:19.680266 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d653ecb8-58ae-40a9-abff-938d52253dd5 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:20.036278 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d653ecb8-58ae-40a9-abff-938d52253dd5 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d75851094d145f4907c7049d78dafed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddc37afc4d54ccab945af619507a613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:20.043626 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-d653ecb8-58ae-40a9-abff-938d52253dd5 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] 10.222.0.45 "GET /compute/v2.1/servers/e742fa97-215c-48de-bc9b-d7c3b17c6cb0" status: 200 len: 1319 microversion: 2.1 time: 0.375349 Jun 03 10:04:20.044193 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 424/887] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:19 2022] GET /compute/v2.1/servers/e742fa97-215c-48de-bc9b-d7c3b17c6cb0 => generated 1319 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:04:20.636229 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-302014bc-a131-4d83-bc3e-a0a0fc5a4fbe tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:20.636827 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-302014bc-a131-4d83-bc3e-a0a0fc5a4fbe tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:20.644201 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell0:SELECT=2 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:04:20.644524 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-b4d82277-7056-4077-9776-33f332d7579a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:20.645205 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-b4d82277-7056-4077-9776-33f332d7579a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:20.646598 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-302014bc-a131-4d83-bc3e-a0a0fc5a4fbe tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:20.647328 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell0:SELECT=2 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:04:20.648107 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-302014bc-a131-4d83-bc3e-a0a0fc5a4fbe tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:20.648735 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell0:SELECT=6 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:04:20.649517 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-302014bc-a131-4d83-bc3e-a0a0fc5a4fbe tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:20.650215 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-302014bc-a131-4d83-bc3e-a0a0fc5a4fbe tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:20.655428 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b4d82277-7056-4077-9776-33f332d7579a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:20.655876 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b4d82277-7056-4077-9776-33f332d7579a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:20.656653 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b4d82277-7056-4077-9776-33f332d7579a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:20.657069 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b4d82277-7056-4077-9776-33f332d7579a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:20.843805 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-302014bc-a131-4d83-bc3e-a0a0fc5a4fbe tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:20.846248 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:04:20.852649 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-302014bc-a131-4d83-bc3e-a0a0fc5a4fbe tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1570 microversion: 2.1 time: 0.220233 Jun 03 10:04:20.853361 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 464/888] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:20 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1570 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:20.855719 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-b4d82277-7056-4077-9776-33f332d7579a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:20.863689 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-b4d82277-7056-4077-9776-33f332d7579a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:20.865185 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-b4d82277-7056-4077-9776-33f332d7579a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:20.866354 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-b4d82277-7056-4077-9776-33f332d7579a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1724 microversion: 2.20 time: 0.226056 Jun 03 10:04:20.866900 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 425/889] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:20 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 10:04:21.061696 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-8a0f166f-b413-49bb-b36b-5d0cf949ec87 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:21.062348 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-8a0f166f-b413-49bb-b36b-5d0cf949ec87 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] [instance: e742fa97-215c-48de-bc9b-d7c3b17c6cb0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:21.069928 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8a0f166f-b413-49bb-b36b-5d0cf949ec87 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:21.070382 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8a0f166f-b413-49bb-b36b-5d0cf949ec87 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:21.071149 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8a0f166f-b413-49bb-b36b-5d0cf949ec87 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:21.071588 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8a0f166f-b413-49bb-b36b-5d0cf949ec87 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:21.196902 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-8a0f166f-b413-49bb-b36b-5d0cf949ec87 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d75851094d145f4907c7049d78dafed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddc37afc4d54ccab945af619507a613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:21.204379 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-8a0f166f-b413-49bb-b36b-5d0cf949ec87 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] 10.222.0.45 "GET /compute/v2.1/servers/e742fa97-215c-48de-bc9b-d7c3b17c6cb0" status: 200 len: 1506 microversion: 2.1 time: 0.147942 Jun 03 10:04:21.204944 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 465/890] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:21 2022] GET /compute/v2.1/servers/e742fa97-215c-48de-bc9b-d7c3b17c6cb0 => generated 1506 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:21.869426 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-b956bde1-cf91-4f48-9dc1-fc41e2c099cf tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:21.870084 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-b956bde1-cf91-4f48-9dc1-fc41e2c099cf tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:21.876613 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b956bde1-cf91-4f48-9dc1-fc41e2c099cf tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:21.877068 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b956bde1-cf91-4f48-9dc1-fc41e2c099cf tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:21.877895 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b956bde1-cf91-4f48-9dc1-fc41e2c099cf tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:21.878339 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b956bde1-cf91-4f48-9dc1-fc41e2c099cf tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:21.884188 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-111e40d4-018d-44bb-9804-457a195a18ad tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:21.884805 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-111e40d4-018d-44bb-9804-457a195a18ad tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:21.891705 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-111e40d4-018d-44bb-9804-457a195a18ad tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:21.892159 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-111e40d4-018d-44bb-9804-457a195a18ad tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:21.892930 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-111e40d4-018d-44bb-9804-457a195a18ad tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:21.893372 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-111e40d4-018d-44bb-9804-457a195a18ad tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:22.094129 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-b956bde1-cf91-4f48-9dc1-fc41e2c099cf tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:22.099061 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-111e40d4-018d-44bb-9804-457a195a18ad tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:22.099673 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell1:SELECT=100 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:04:22.105706 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-b956bde1-cf91-4f48-9dc1-fc41e2c099cf tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1570 microversion: 2.1 time: 0.239963 Jun 03 10:04:22.106742 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 426/891] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:21 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1570 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:22.108505 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-111e40d4-018d-44bb-9804-457a195a18ad tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:22.110349 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-111e40d4-018d-44bb-9804-457a195a18ad tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:22.111729 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-111e40d4-018d-44bb-9804-457a195a18ad tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1724 microversion: 2.20 time: 0.231380 Jun 03 10:04:22.115945 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 466/892] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:21 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1724 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 10:04:23.123546 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-f7a7e3aa-4090-4669-b046-38b0612904ad tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:23.124359 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-f7a7e3aa-4090-4669-b046-38b0612904ad tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:23.131904 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f7a7e3aa-4090-4669-b046-38b0612904ad tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:23.132348 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f7a7e3aa-4090-4669-b046-38b0612904ad tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:23.132704 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-dd8076a5-95d2-49d3-a1a5-150ced548ced tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:23.133177 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f7a7e3aa-4090-4669-b046-38b0612904ad tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:23.133329 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-dd8076a5-95d2-49d3-a1a5-150ced548ced tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:23.133532 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f7a7e3aa-4090-4669-b046-38b0612904ad tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:23.140409 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-dd8076a5-95d2-49d3-a1a5-150ced548ced tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:23.140872 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-dd8076a5-95d2-49d3-a1a5-150ced548ced tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:23.141649 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-dd8076a5-95d2-49d3-a1a5-150ced548ced tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:23.142118 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-dd8076a5-95d2-49d3-a1a5-150ced548ced tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:23.334849 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f7a7e3aa-4090-4669-b046-38b0612904ad tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:23.337912 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-dd8076a5-95d2-49d3-a1a5-150ced548ced tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:23.343170 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-f7a7e3aa-4090-4669-b046-38b0612904ad tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1570 microversion: 2.1 time: 0.224061 Jun 03 10:04:23.346437 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 427/893] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:23 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1570 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:23.348423 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-dd8076a5-95d2-49d3-a1a5-150ced548ced tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:23.350232 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-dd8076a5-95d2-49d3-a1a5-150ced548ced tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:23.351534 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-dd8076a5-95d2-49d3-a1a5-150ced548ced tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1745 microversion: 2.20 time: 0.222842 Jun 03 10:04:23.352197 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 467/894] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:23 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1745 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 10:04:24.249955 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-3a2c04f4-bb62-4106-bcce-45848899b1c2 req-605de340-ccc6-479b-8f1d-43755848b3d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02de8459-bf38-485f-971a-d8f1d7909898", "name": "network-vif-plugged", "status": "completed", "tag": "5b00cee1-834c-4ff1-b027-9118ca362265"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:04:24.259217 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-3a2c04f4-bb62-4106-bcce-45848899b1c2 req-605de340-ccc6-479b-8f1d-43755848b3d9 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:24.259716 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-3a2c04f4-bb62-4106-bcce-45848899b1c2 req-605de340-ccc6-479b-8f1d-43755848b3d9 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:24.274084 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-3a2c04f4-bb62-4106-bcce-45848899b1c2 req-605de340-ccc6-479b-8f1d-43755848b3d9 service nova] Creating event network-vif-plugged:5b00cee1-834c-4ff1-b027-9118ca362265 for instance 02de8459-bf38-485f-971a-d8f1d7909898 on hv-cinder-79760 Jun 03 10:04:24.280187 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-3a2c04f4-bb62-4106-bcce-45848899b1c2 req-605de340-ccc6-479b-8f1d-43755848b3d9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033617 Jun 03 10:04:24.280803 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 428/895] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:04:24.360786 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-72ce9373-3aec-480d-b63d-b723d94dd865 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:24.361430 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-72ce9373-3aec-480d-b63d-b723d94dd865 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:24.368940 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-72ce9373-3aec-480d-b63d-b723d94dd865 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:24.369469 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-72ce9373-3aec-480d-b63d-b723d94dd865 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:24.370212 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-6978245c-2657-45a0-8e82-a265f58d6026 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:24.370408 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-72ce9373-3aec-480d-b63d-b723d94dd865 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:24.370927 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-6978245c-2657-45a0-8e82-a265f58d6026 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:24.371043 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-72ce9373-3aec-480d-b63d-b723d94dd865 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:24.377154 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6978245c-2657-45a0-8e82-a265f58d6026 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:24.377607 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6978245c-2657-45a0-8e82-a265f58d6026 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:24.378409 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6978245c-2657-45a0-8e82-a265f58d6026 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:24.378846 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6978245c-2657-45a0-8e82-a265f58d6026 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:24.569243 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-72ce9373-3aec-480d-b63d-b723d94dd865 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:24.575732 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-6978245c-2657-45a0-8e82-a265f58d6026 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:24.576789 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-72ce9373-3aec-480d-b63d-b723d94dd865 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1570 microversion: 2.1 time: 0.220432 Jun 03 10:04:24.577358 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 468/896] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:24 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1570 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:24.583766 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-6978245c-2657-45a0-8e82-a265f58d6026 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:24.585289 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-6978245c-2657-45a0-8e82-a265f58d6026 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:24.586482 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-6978245c-2657-45a0-8e82-a265f58d6026 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1745 microversion: 2.20 time: 0.220334 Jun 03 10:04:24.587035 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 429/897] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:24 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1745 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 10:04:25.602439 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-d4516480-e304-405d-8a67-eaeeac23915c tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:25.603330 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-d4516480-e304-405d-8a67-eaeeac23915c tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:25.611462 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d4516480-e304-405d-8a67-eaeeac23915c tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:25.612174 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d4516480-e304-405d-8a67-eaeeac23915c tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:25.612637 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-cccd1467-25a8-47e9-922e-c736538b1a06 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:25.613335 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d4516480-e304-405d-8a67-eaeeac23915c tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:25.613900 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d4516480-e304-405d-8a67-eaeeac23915c tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:25.614274 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-cccd1467-25a8-47e9-922e-c736538b1a06 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:25.630174 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cccd1467-25a8-47e9-922e-c736538b1a06 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:25.630953 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cccd1467-25a8-47e9-922e-c736538b1a06 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:25.632011 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cccd1467-25a8-47e9-922e-c736538b1a06 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:25.632613 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cccd1467-25a8-47e9-922e-c736538b1a06 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:25.875101 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-cccd1467-25a8-47e9-922e-c736538b1a06 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:25.880105 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-d4516480-e304-405d-8a67-eaeeac23915c tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:25.884257 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-cccd1467-25a8-47e9-922e-c736538b1a06 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:25.887101 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-cccd1467-25a8-47e9-922e-c736538b1a06 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:25.889241 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-cccd1467-25a8-47e9-922e-c736538b1a06 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1740 microversion: 2.20 time: 0.287932 Jun 03 10:04:25.900210 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 430/898] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:25 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1740 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:25.900384 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-d4516480-e304-405d-8a67-eaeeac23915c tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1570 microversion: 2.1 time: 0.297938 Jun 03 10:04:25.900384 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 469/899] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:25 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1570 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:26.909717 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-a6cecb7b-a54f-4073-a421-d983584243f6 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:26.910356 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-a6cecb7b-a54f-4073-a421-d983584243f6 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:26.912493 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-19de4274-c36c-4cff-b202-963c9aef12a2 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:26.913112 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-19de4274-c36c-4cff-b202-963c9aef12a2 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:26.919043 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a6cecb7b-a54f-4073-a421-d983584243f6 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:26.923681 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-19de4274-c36c-4cff-b202-963c9aef12a2 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:26.924774 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-19de4274-c36c-4cff-b202-963c9aef12a2 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:26.925912 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-19de4274-c36c-4cff-b202-963c9aef12a2 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:26.926611 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-19de4274-c36c-4cff-b202-963c9aef12a2 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:26.927162 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a6cecb7b-a54f-4073-a421-d983584243f6 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:26.928102 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a6cecb7b-a54f-4073-a421-d983584243f6 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:26.928553 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a6cecb7b-a54f-4073-a421-d983584243f6 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:27.182606 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-19de4274-c36c-4cff-b202-963c9aef12a2 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:27.191730 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-19de4274-c36c-4cff-b202-963c9aef12a2 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1570 microversion: 2.1 time: 0.283228 Jun 03 10:04:27.200056 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-a6cecb7b-a54f-4073-a421-d983584243f6 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:27.204547 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 470/900] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:26 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1570 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:27.209490 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-a6cecb7b-a54f-4073-a421-d983584243f6 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:27.212043 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-a6cecb7b-a54f-4073-a421-d983584243f6 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:27.213215 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-a6cecb7b-a54f-4073-a421-d983584243f6 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1740 microversion: 2.20 time: 0.308031 Jun 03 10:04:27.214010 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 431/901] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:26 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1740 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:28.212990 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-20c4ed54-81d7-42df-8919-360f9ba49721 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:28.214516 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-20c4ed54-81d7-42df-8919-360f9ba49721 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:28.222336 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-20c4ed54-81d7-42df-8919-360f9ba49721 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:28.222993 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-20c4ed54-81d7-42df-8919-360f9ba49721 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:28.224028 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-20c4ed54-81d7-42df-8919-360f9ba49721 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:28.224670 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-20c4ed54-81d7-42df-8919-360f9ba49721 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:28.238498 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-4ed5b160-dcf4-4e25-9054-1aa504216b2c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:28.239743 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-4ed5b160-dcf4-4e25-9054-1aa504216b2c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:28.249679 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4ed5b160-dcf4-4e25-9054-1aa504216b2c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:28.250716 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4ed5b160-dcf4-4e25-9054-1aa504216b2c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:28.251790 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4ed5b160-dcf4-4e25-9054-1aa504216b2c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:28.252413 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4ed5b160-dcf4-4e25-9054-1aa504216b2c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:28.459724 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-20c4ed54-81d7-42df-8919-360f9ba49721 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:28.470164 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-20c4ed54-81d7-42df-8919-360f9ba49721 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1570 microversion: 2.1 time: 0.262545 Jun 03 10:04:28.479639 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 471/902] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:28 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1570 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:28.491100 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-4ed5b160-dcf4-4e25-9054-1aa504216b2c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:28.502411 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-4ed5b160-dcf4-4e25-9054-1aa504216b2c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:28.503905 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-4ed5b160-dcf4-4e25-9054-1aa504216b2c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:28.505629 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-4ed5b160-dcf4-4e25-9054-1aa504216b2c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1740 microversion: 2.20 time: 0.273546 Jun 03 10:04:28.506254 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 432/903] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:28 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1740 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 10:04:29.487843 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-91484696-3b24-4901-ad5d-376de6fcf28a tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:29.488456 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-91484696-3b24-4901-ad5d-376de6fcf28a tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:29.495714 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-91484696-3b24-4901-ad5d-376de6fcf28a tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:29.496258 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-91484696-3b24-4901-ad5d-376de6fcf28a tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:29.497308 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-91484696-3b24-4901-ad5d-376de6fcf28a tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:29.498612 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-91484696-3b24-4901-ad5d-376de6fcf28a tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:29.524337 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-4b9fd061-6310-4e8a-9246-a5c4fadec0d1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:29.524956 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-4b9fd061-6310-4e8a-9246-a5c4fadec0d1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:29.535492 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4b9fd061-6310-4e8a-9246-a5c4fadec0d1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:29.535949 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4b9fd061-6310-4e8a-9246-a5c4fadec0d1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:29.537007 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4b9fd061-6310-4e8a-9246-a5c4fadec0d1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:29.537449 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4b9fd061-6310-4e8a-9246-a5c4fadec0d1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:29.705123 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-91484696-3b24-4901-ad5d-376de6fcf28a tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:29.720096 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-91484696-3b24-4901-ad5d-376de6fcf28a tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1570 microversion: 2.1 time: 0.235105 Jun 03 10:04:29.721049 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 472/904] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:29 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1570 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:29.748530 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-4b9fd061-6310-4e8a-9246-a5c4fadec0d1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:29.756852 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-4b9fd061-6310-4e8a-9246-a5c4fadec0d1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:29.758383 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-4b9fd061-6310-4e8a-9246-a5c4fadec0d1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:29.764153 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-4b9fd061-6310-4e8a-9246-a5c4fadec0d1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1740 microversion: 2.20 time: 0.243624 Jun 03 10:04:29.764908 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 433/905] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:29 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1740 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 10:04:30.753719 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-60da8720-8b4b-4210-87b0-176708cd2c80 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:30.755001 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-60da8720-8b4b-4210-87b0-176708cd2c80 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:30.761444 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-60da8720-8b4b-4210-87b0-176708cd2c80 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:30.761924 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-60da8720-8b4b-4210-87b0-176708cd2c80 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:30.762701 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-60da8720-8b4b-4210-87b0-176708cd2c80 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:30.763131 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-60da8720-8b4b-4210-87b0-176708cd2c80 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:30.783095 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-de9a638f-664a-4ec3-97b1-6fcf41f2a8d3 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:30.783784 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-de9a638f-664a-4ec3-97b1-6fcf41f2a8d3 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:30.790694 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-de9a638f-664a-4ec3-97b1-6fcf41f2a8d3 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:30.791145 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-de9a638f-664a-4ec3-97b1-6fcf41f2a8d3 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:30.792277 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-de9a638f-664a-4ec3-97b1-6fcf41f2a8d3 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:30.792365 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-de9a638f-664a-4ec3-97b1-6fcf41f2a8d3 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:31.002514 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-de9a638f-664a-4ec3-97b1-6fcf41f2a8d3 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:31.006424 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-60da8720-8b4b-4210-87b0-176708cd2c80 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:31.022108 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-60da8720-8b4b-4210-87b0-176708cd2c80 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1570 microversion: 2.1 time: 0.280902 Jun 03 10:04:31.028882 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-de9a638f-664a-4ec3-97b1-6fcf41f2a8d3 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:31.031017 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-de9a638f-664a-4ec3-97b1-6fcf41f2a8d3 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:31.032215 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-de9a638f-664a-4ec3-97b1-6fcf41f2a8d3 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1740 microversion: 2.20 time: 0.253765 Jun 03 10:04:31.032950 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 434/906] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:30 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1740 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:31.043665 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 473/907] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:30 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1570 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:32.041728 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-83a32ea8-8c54-4ba8-97a0-185fac40f42a tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:32.042427 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-83a32ea8-8c54-4ba8-97a0-185fac40f42a tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:32.052529 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-56595d75-8400-476f-ac21-b50b32ee440e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:32.053420 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-56595d75-8400-476f-ac21-b50b32ee440e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:32.059278 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-83a32ea8-8c54-4ba8-97a0-185fac40f42a tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:32.059761 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-83a32ea8-8c54-4ba8-97a0-185fac40f42a tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:32.060606 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-83a32ea8-8c54-4ba8-97a0-185fac40f42a tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:32.061153 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-83a32ea8-8c54-4ba8-97a0-185fac40f42a tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:32.061276 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-56595d75-8400-476f-ac21-b50b32ee440e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:32.061704 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-56595d75-8400-476f-ac21-b50b32ee440e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:32.062530 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-56595d75-8400-476f-ac21-b50b32ee440e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:32.062970 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-56595d75-8400-476f-ac21-b50b32ee440e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:32.303067 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-83a32ea8-8c54-4ba8-97a0-185fac40f42a tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:32.318392 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-83a32ea8-8c54-4ba8-97a0-185fac40f42a tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1511 microversion: 2.1 time: 0.280813 Jun 03 10:04:32.319103 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 435/908] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:32 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1511 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:32.323765 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-46fb2230-00f0-42f0-89b0-3e126037f4da req-00c80f3b-05cf-422f-a075-6213aab71f29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a0aa280-d0b4-42e3-8dd4-e222a70d0f10", "name": "network-vif-unplugged", "status": "completed", "tag": "11ea2cd5-6468-4db5-8bec-8a0e6b1acff8"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:04:32.330670 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-56595d75-8400-476f-ac21-b50b32ee440e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:32.355074 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-56595d75-8400-476f-ac21-b50b32ee440e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:32.360611 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-46fb2230-00f0-42f0-89b0-3e126037f4da req-00c80f3b-05cf-422f-a075-6213aab71f29 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:32.361057 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-46fb2230-00f0-42f0-89b0-3e126037f4da req-00c80f3b-05cf-422f-a075-6213aab71f29 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:32.363058 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-56595d75-8400-476f-ac21-b50b32ee440e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:32.364302 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-56595d75-8400-476f-ac21-b50b32ee440e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1740 microversion: 2.20 time: 0.315933 Jun 03 10:04:32.364872 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 474/909] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:32 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1740 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:32.369622 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-f43aa80b-3c5a-4fcf-ac4b-89291b8374fb tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:04:32.370221 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-f43aa80b-3c5a-4fcf-ac4b-89291b8374fb tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:32.397364 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f43aa80b-3c5a-4fcf-ac4b-89291b8374fb tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:32.397862 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f43aa80b-3c5a-4fcf-ac4b-89291b8374fb tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:32.398668 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f43aa80b-3c5a-4fcf-ac4b-89291b8374fb tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:32.399114 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f43aa80b-3c5a-4fcf-ac4b-89291b8374fb tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:32.405436 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.compute.server_external_events [req-46fb2230-00f0-42f0-89b0-3e126037f4da req-00c80f3b-05cf-422f-a075-6213aab71f29 service nova] Unable to find a host for instance 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10. Dropping event network-vif-unplugged {{(pid=117648) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 03 10:04:32.406402 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-46fb2230-00f0-42f0-89b0-3e126037f4da req-00c80f3b-05cf-422f-a075-6213aab71f29 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.086283 Jun 03 10:04:32.407207 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 436/910] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 87 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 03 10:04:32.525320 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-f43aa80b-3c5a-4fcf-ac4b-89291b8374fb tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "POST /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10/action" status: 202 len: 0 microversion: 2.1 time: 0.159066 Jun 03 10:04:32.526244 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 475/911] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jun 3 10:04:32 2022] POST /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 10:04:32.535382 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-3eb25984-ceb9-44af-a2aa-d2507c88f328 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:32.536014 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-3eb25984-ceb9-44af-a2aa-d2507c88f328 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:32.543669 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3eb25984-ceb9-44af-a2aa-d2507c88f328 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:32.544122 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3eb25984-ceb9-44af-a2aa-d2507c88f328 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:32.545100 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3eb25984-ceb9-44af-a2aa-d2507c88f328 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:32.545797 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3eb25984-ceb9-44af-a2aa-d2507c88f328 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:32.744103 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-3eb25984-ceb9-44af-a2aa-d2507c88f328 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:32.757014 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-3eb25984-ceb9-44af-a2aa-d2507c88f328 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1519 microversion: 2.1 time: 0.223681 Jun 03 10:04:32.757014 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 437/912] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:32 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1519 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:33.406178 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-78d5b8e1-c6b9-4aef-adb7-b8bcf7cd6d56 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:33.406822 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-78d5b8e1-c6b9-4aef-adb7-b8bcf7cd6d56 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:33.417342 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-78d5b8e1-c6b9-4aef-adb7-b8bcf7cd6d56 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:33.417812 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-78d5b8e1-c6b9-4aef-adb7-b8bcf7cd6d56 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:33.418733 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-78d5b8e1-c6b9-4aef-adb7-b8bcf7cd6d56 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:33.419168 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-78d5b8e1-c6b9-4aef-adb7-b8bcf7cd6d56 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:33.584780 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-78d5b8e1-c6b9-4aef-adb7-b8bcf7cd6d56 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:33.594909 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-78d5b8e1-c6b9-4aef-adb7-b8bcf7cd6d56 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:33.596515 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-78d5b8e1-c6b9-4aef-adb7-b8bcf7cd6d56 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:33.597827 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-78d5b8e1-c6b9-4aef-adb7-b8bcf7cd6d56 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1740 microversion: 2.20 time: 0.210019 Jun 03 10:04:33.601805 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 476/913] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:33 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1740 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:33.771490 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-260b784d-4c93-4444-b8f3-6262202115b5 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:33.772139 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-260b784d-4c93-4444-b8f3-6262202115b5 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:33.779217 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-260b784d-4c93-4444-b8f3-6262202115b5 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:33.779596 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-260b784d-4c93-4444-b8f3-6262202115b5 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:33.780473 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-260b784d-4c93-4444-b8f3-6262202115b5 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:33.780815 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-260b784d-4c93-4444-b8f3-6262202115b5 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:33.924349 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-260b784d-4c93-4444-b8f3-6262202115b5 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:33.932644 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-260b784d-4c93-4444-b8f3-6262202115b5 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1521 microversion: 2.1 time: 0.164991 Jun 03 10:04:33.934565 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 438/914] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:33 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:34.616442 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-e6198582-bf88-4b63-a2e2-c46c4e261cb4 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:34.617069 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-e6198582-bf88-4b63-a2e2-c46c4e261cb4 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:34.623281 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e6198582-bf88-4b63-a2e2-c46c4e261cb4 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:34.623733 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e6198582-bf88-4b63-a2e2-c46c4e261cb4 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:34.624917 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e6198582-bf88-4b63-a2e2-c46c4e261cb4 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:34.625551 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e6198582-bf88-4b63-a2e2-c46c4e261cb4 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:34.762633 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-e6198582-bf88-4b63-a2e2-c46c4e261cb4 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:34.771370 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-e6198582-bf88-4b63-a2e2-c46c4e261cb4 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:34.772911 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-e6198582-bf88-4b63-a2e2-c46c4e261cb4 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:34.774120 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-e6198582-bf88-4b63-a2e2-c46c4e261cb4 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1740 microversion: 2.20 time: 0.161686 Jun 03 10:04:34.774678 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 477/915] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:34 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1740 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:34.951667 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-0ed7050d-43f8-4881-bd74-8c50f0e97cfa tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:34.952290 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-0ed7050d-43f8-4881-bd74-8c50f0e97cfa tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:34.959307 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0ed7050d-43f8-4881-bd74-8c50f0e97cfa tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:34.959761 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0ed7050d-43f8-4881-bd74-8c50f0e97cfa tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:34.960563 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0ed7050d-43f8-4881-bd74-8c50f0e97cfa tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:34.961036 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0ed7050d-43f8-4881-bd74-8c50f0e97cfa tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:35.092557 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-0ed7050d-43f8-4881-bd74-8c50f0e97cfa tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:35.100016 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-0ed7050d-43f8-4881-bd74-8c50f0e97cfa tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1577 microversion: 2.1 time: 0.152279 Jun 03 10:04:35.100578 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 439/916] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:34 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:35.792827 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-42c39c67-9d63-4731-9025-280f13d13b99 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:35.793588 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-42c39c67-9d63-4731-9025-280f13d13b99 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:35.800857 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-42c39c67-9d63-4731-9025-280f13d13b99 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:35.801396 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-42c39c67-9d63-4731-9025-280f13d13b99 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:35.802205 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-42c39c67-9d63-4731-9025-280f13d13b99 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:35.802647 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-42c39c67-9d63-4731-9025-280f13d13b99 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:35.929972 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-42c39c67-9d63-4731-9025-280f13d13b99 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:35.938891 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-42c39c67-9d63-4731-9025-280f13d13b99 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:35.940411 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-42c39c67-9d63-4731-9025-280f13d13b99 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:35.941589 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-42c39c67-9d63-4731-9025-280f13d13b99 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1722 microversion: 2.20 time: 0.152748 Jun 03 10:04:35.942604 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 478/917] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:35 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:36.116427 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-edee2c10-2178-4a4b-90c7-b57c7a0d73d7 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:36.117130 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-edee2c10-2178-4a4b-90c7-b57c7a0d73d7 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:36.124579 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-edee2c10-2178-4a4b-90c7-b57c7a0d73d7 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:36.125031 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-edee2c10-2178-4a4b-90c7-b57c7a0d73d7 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:36.125830 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-edee2c10-2178-4a4b-90c7-b57c7a0d73d7 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:36.126272 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-edee2c10-2178-4a4b-90c7-b57c7a0d73d7 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:36.260995 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-edee2c10-2178-4a4b-90c7-b57c7a0d73d7 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:36.270388 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-edee2c10-2178-4a4b-90c7-b57c7a0d73d7 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1577 microversion: 2.1 time: 0.157650 Jun 03 10:04:36.270975 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 440/918] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:36 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:36.960067 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-19b1da5b-8b74-4717-86fb-4fee2f5c4ed4 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:36.960684 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-19b1da5b-8b74-4717-86fb-4fee2f5c4ed4 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:36.967786 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-19b1da5b-8b74-4717-86fb-4fee2f5c4ed4 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:36.968237 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-19b1da5b-8b74-4717-86fb-4fee2f5c4ed4 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:36.969005 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-19b1da5b-8b74-4717-86fb-4fee2f5c4ed4 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:36.969491 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-19b1da5b-8b74-4717-86fb-4fee2f5c4ed4 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:37.100894 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-19b1da5b-8b74-4717-86fb-4fee2f5c4ed4 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:37.108823 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-19b1da5b-8b74-4717-86fb-4fee2f5c4ed4 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:37.110428 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-19b1da5b-8b74-4717-86fb-4fee2f5c4ed4 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:37.111624 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-19b1da5b-8b74-4717-86fb-4fee2f5c4ed4 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1722 microversion: 2.20 time: 0.155496 Jun 03 10:04:37.112188 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 479/919] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:36 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:37.288176 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-ea098126-1c1d-48e1-a47c-47588ffcf0ce tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:37.288690 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-ea098126-1c1d-48e1-a47c-47588ffcf0ce tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:37.295239 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ea098126-1c1d-48e1-a47c-47588ffcf0ce tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:37.295685 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ea098126-1c1d-48e1-a47c-47588ffcf0ce tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:37.296454 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ea098126-1c1d-48e1-a47c-47588ffcf0ce tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:37.296895 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ea098126-1c1d-48e1-a47c-47588ffcf0ce tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:37.427250 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-ea098126-1c1d-48e1-a47c-47588ffcf0ce tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:37.436611 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-ea098126-1c1d-48e1-a47c-47588ffcf0ce tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1577 microversion: 2.1 time: 0.152658 Jun 03 10:04:37.437171 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 441/920] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:37 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:38.129684 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-1c39e51f-c31d-4b7d-afd0-9fc9653ccdd9 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:38.130318 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-1c39e51f-c31d-4b7d-afd0-9fc9653ccdd9 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:38.136762 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1c39e51f-c31d-4b7d-afd0-9fc9653ccdd9 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:38.137207 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1c39e51f-c31d-4b7d-afd0-9fc9653ccdd9 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:38.137989 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1c39e51f-c31d-4b7d-afd0-9fc9653ccdd9 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:38.138914 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1c39e51f-c31d-4b7d-afd0-9fc9653ccdd9 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:38.153365 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:04:38.268658 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-1b5919c8-8104-4e0e-b020-d15006b3f37e req-bfb278bc-f2f3-4902-95d3-791629571749 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02de8459-bf38-485f-971a-d8f1d7909898", "name": "network-vif-unplugged", "status": "completed", "tag": "5b00cee1-834c-4ff1-b027-9118ca362265"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:04:38.273896 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-1c39e51f-c31d-4b7d-afd0-9fc9653ccdd9 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:38.283277 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-1c39e51f-c31d-4b7d-afd0-9fc9653ccdd9 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:38.287954 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-1c39e51f-c31d-4b7d-afd0-9fc9653ccdd9 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:38.291706 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-1b5919c8-8104-4e0e-b020-d15006b3f37e req-bfb278bc-f2f3-4902-95d3-791629571749 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:38.292163 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-1b5919c8-8104-4e0e-b020-d15006b3f37e req-bfb278bc-f2f3-4902-95d3-791629571749 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:38.293391 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-1c39e51f-c31d-4b7d-afd0-9fc9653ccdd9 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1722 microversion: 2.20 time: 0.167647 Jun 03 10:04:38.293988 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 480/921] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:38 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:38.305484 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-1b5919c8-8104-4e0e-b020-d15006b3f37e req-bfb278bc-f2f3-4902-95d3-791629571749 service nova] Creating event network-vif-unplugged:5b00cee1-834c-4ff1-b027-9118ca362265 for instance 02de8459-bf38-485f-971a-d8f1d7909898 on hv-cinder-79760 Jun 03 10:04:38.310612 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-1b5919c8-8104-4e0e-b020-d15006b3f37e req-bfb278bc-f2f3-4902-95d3-791629571749 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046844 Jun 03 10:04:38.311217 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 442/922] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 10:04:38.453811 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-5eb7901d-4f85-4132-8397-a34e96307f23 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:38.454466 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-5eb7901d-4f85-4132-8397-a34e96307f23 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:38.460388 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5eb7901d-4f85-4132-8397-a34e96307f23 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:38.460842 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5eb7901d-4f85-4132-8397-a34e96307f23 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:38.461615 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5eb7901d-4f85-4132-8397-a34e96307f23 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:38.462088 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5eb7901d-4f85-4132-8397-a34e96307f23 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:38.595716 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-5eb7901d-4f85-4132-8397-a34e96307f23 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:38.603304 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-5eb7901d-4f85-4132-8397-a34e96307f23 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1577 microversion: 2.1 time: 0.153873 Jun 03 10:04:38.603878 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 481/923] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:38 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:04:39.312707 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-fdc351d7-710f-41bc-9c02-fc2b273bd2b2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:39.313560 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-fdc351d7-710f-41bc-9c02-fc2b273bd2b2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:39.320170 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fdc351d7-710f-41bc-9c02-fc2b273bd2b2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:39.320627 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fdc351d7-710f-41bc-9c02-fc2b273bd2b2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:39.321399 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fdc351d7-710f-41bc-9c02-fc2b273bd2b2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:39.321875 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fdc351d7-710f-41bc-9c02-fc2b273bd2b2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:39.454473 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-fdc351d7-710f-41bc-9c02-fc2b273bd2b2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:39.462354 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-fdc351d7-710f-41bc-9c02-fc2b273bd2b2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:39.463867 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-fdc351d7-710f-41bc-9c02-fc2b273bd2b2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:39.465034 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-fdc351d7-710f-41bc-9c02-fc2b273bd2b2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1722 microversion: 2.20 time: 0.157081 Jun 03 10:04:39.465595 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 443/924] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:39 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:39.620572 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-5719d0bd-7e9f-4ad4-b00a-1a59792604b6 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:39.621251 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-5719d0bd-7e9f-4ad4-b00a-1a59792604b6 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:39.628300 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5719d0bd-7e9f-4ad4-b00a-1a59792604b6 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:39.628750 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5719d0bd-7e9f-4ad4-b00a-1a59792604b6 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:39.629519 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5719d0bd-7e9f-4ad4-b00a-1a59792604b6 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:39.629984 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5719d0bd-7e9f-4ad4-b00a-1a59792604b6 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:39.761458 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-5719d0bd-7e9f-4ad4-b00a-1a59792604b6 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:39.769121 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-5719d0bd-7e9f-4ad4-b00a-1a59792604b6 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1577 microversion: 2.1 time: 0.152609 Jun 03 10:04:39.769699 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 482/925] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:39 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:40.483298 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-9bd994f9-93b3-4f82-9d58-88135a013c62 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:40.483918 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-9bd994f9-93b3-4f82-9d58-88135a013c62 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:40.490716 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9bd994f9-93b3-4f82-9d58-88135a013c62 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:40.491161 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9bd994f9-93b3-4f82-9d58-88135a013c62 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:40.491923 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9bd994f9-93b3-4f82-9d58-88135a013c62 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:40.492355 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9bd994f9-93b3-4f82-9d58-88135a013c62 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:40.595632 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-47c3b6e7-aee5-400d-9fc9-e4d8aa913bc1 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af786d1d-a451-4ea5-b847-5a36a931bc9a", "device": "/dev/sdb"}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:04:40.597276 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-47c3b6e7-aee5-400d-9fc9-e4d8aa913bc1 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] [instance: e742fa97-215c-48de-bc9b-d7c3b17c6cb0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:40.603388 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-47c3b6e7-aee5-400d-9fc9-e4d8aa913bc1 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:40.603836 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-47c3b6e7-aee5-400d-9fc9-e4d8aa913bc1 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:40.604605 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-47c3b6e7-aee5-400d-9fc9-e4d8aa913bc1 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:40.605061 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-47c3b6e7-aee5-400d-9fc9-e4d8aa913bc1 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:40.620742 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-9bd994f9-93b3-4f82-9d58-88135a013c62 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:40.629913 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-9bd994f9-93b3-4f82-9d58-88135a013c62 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:40.631430 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-9bd994f9-93b3-4f82-9d58-88135a013c62 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:40.632659 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-9bd994f9-93b3-4f82-9d58-88135a013c62 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1665 microversion: 2.20 time: 0.153795 Jun 03 10:04:40.633224 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 444/926] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:40 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1665 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:40.650114 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-69c354bd-39af-4530-a0e2-9dd8ad543496 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "355a3022-dd67-45c8-b0a6-eb638662f112"}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:04:40.651122 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-69c354bd-39af-4530-a0e2-9dd8ad543496 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:40.657379 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-69c354bd-39af-4530-a0e2-9dd8ad543496 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:40.657838 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-69c354bd-39af-4530-a0e2-9dd8ad543496 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:40.658617 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-69c354bd-39af-4530-a0e2-9dd8ad543496 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:40.659063 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-69c354bd-39af-4530-a0e2-9dd8ad543496 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:40.676614 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell1:SELECT=100 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:04:40.884351 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-47c3b6e7-aee5-400d-9fc9-e4d8aa913bc1 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] 10.222.0.45 "POST /compute/v2.1/servers/e742fa97-215c-48de-bc9b-d7c3b17c6cb0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.292394 Jun 03 10:04:40.887715 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 483/927] 10.222.0.45 () {60 vars in 1322 bytes} [Fri Jun 3 10:04:40 2022] POST /compute/v2.1/servers/e742fa97-215c-48de-bc9b-d7c3b17c6cb0/os-volume_attachments => generated 194 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 10:04:40.895749 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-e36a337b-90a8-4b82-8822-f2d90d8e68bd tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:40.896453 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-e36a337b-90a8-4b82-8822-f2d90d8e68bd tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:40.903171 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e36a337b-90a8-4b82-8822-f2d90d8e68bd tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:40.903634 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e36a337b-90a8-4b82-8822-f2d90d8e68bd tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:40.904892 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e36a337b-90a8-4b82-8822-f2d90d8e68bd tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:40.905324 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e36a337b-90a8-4b82-8822-f2d90d8e68bd tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:40.983646 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-69c354bd-39af-4530-a0e2-9dd8ad543496 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "POST /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.337517 Jun 03 10:04:40.984702 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 445/928] 10.222.0.45 () {62 vars in 1363 bytes} [Fri Jun 3 10:04:40 2022] POST /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898/os-volume_attachments => generated 188 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 03 10:04:41.066411 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-e36a337b-90a8-4b82-8822-f2d90d8e68bd tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:41.076173 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-e36a337b-90a8-4b82-8822-f2d90d8e68bd tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1577 microversion: 2.1 time: 0.185359 Jun 03 10:04:41.076942 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 484/929] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:40 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1577 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:41.100299 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-9d5a97dd-941e-405b-b395-2176ec8bcb84 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:41.100809 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-9d5a97dd-941e-405b-b395-2176ec8bcb84 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:41.108106 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9d5a97dd-941e-405b-b395-2176ec8bcb84 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:41.108555 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9d5a97dd-941e-405b-b395-2176ec8bcb84 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:41.109330 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9d5a97dd-941e-405b-b395-2176ec8bcb84 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:41.109787 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9d5a97dd-941e-405b-b395-2176ec8bcb84 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:41.380968 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-9d5a97dd-941e-405b-b395-2176ec8bcb84 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "DELETE /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898/os-volume_attachments/355a3022-dd67-45c8-b0a6-eb638662f112" status: 202 len: 0 microversion: 2.20 time: 0.284574 Jun 03 10:04:41.381605 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 446/930] 10.222.0.45 () {60 vars in 1456 bytes} [Fri Jun 3 10:04:41 2022] DELETE /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898/os-volume_attachments/355a3022-dd67-45c8-b0a6-eb638662f112 => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 03 10:04:41.439171 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-80fe487f-57e0-4095-a8cb-a1860edd7db4 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:04:41.439775 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-80fe487f-57e0-4095-a8cb-a1860edd7db4 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:41.446557 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-80fe487f-57e0-4095-a8cb-a1860edd7db4 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:41.447030 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-80fe487f-57e0-4095-a8cb-a1860edd7db4 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:41.447792 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-80fe487f-57e0-4095-a8cb-a1860edd7db4 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:41.448228 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-80fe487f-57e0-4095-a8cb-a1860edd7db4 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:41.523286 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-80fe487f-57e0-4095-a8cb-a1860edd7db4 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "POST /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898/action" status: 202 len: 0 microversion: 2.20 time: 0.087811 Jun 03 10:04:41.523928 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 485/931] 10.222.0.45 () {62 vars in 1318 bytes} [Fri Jun 3 10:04:41 2022] POST /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 03 10:04:41.532730 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-7f6c92c5-707e-47c5-bddf-7f14b26485e9 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:41.533341 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-7f6c92c5-707e-47c5-bddf-7f14b26485e9 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:41.540886 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7f6c92c5-707e-47c5-bddf-7f14b26485e9 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:41.541329 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7f6c92c5-707e-47c5-bddf-7f14b26485e9 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:41.542143 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7f6c92c5-707e-47c5-bddf-7f14b26485e9 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:41.542745 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7f6c92c5-707e-47c5-bddf-7f14b26485e9 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:41.679124 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-7f6c92c5-707e-47c5-bddf-7f14b26485e9 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:41.687758 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-7f6c92c5-707e-47c5-bddf-7f14b26485e9 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:41.689260 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-7f6c92c5-707e-47c5-bddf-7f14b26485e9 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:41.690450 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-7f6c92c5-707e-47c5-bddf-7f14b26485e9 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1673 microversion: 2.20 time: 0.162169 Jun 03 10:04:41.691017 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 447/932] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:41 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1673 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:42.093840 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-6cfb46ff-cc6a-4e00-9de4-7896695adc13 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:42.094458 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-6cfb46ff-cc6a-4e00-9de4-7896695adc13 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:42.100676 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6cfb46ff-cc6a-4e00-9de4-7896695adc13 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:42.101121 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6cfb46ff-cc6a-4e00-9de4-7896695adc13 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:42.101992 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6cfb46ff-cc6a-4e00-9de4-7896695adc13 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:42.102433 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6cfb46ff-cc6a-4e00-9de4-7896695adc13 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:42.240506 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-6cfb46ff-cc6a-4e00-9de4-7896695adc13 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:42.250836 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-6cfb46ff-cc6a-4e00-9de4-7896695adc13 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1577 microversion: 2.1 time: 0.161323 Jun 03 10:04:42.251456 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 486/933] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:42 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:42.708426 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-cdd4d0e9-b76a-456d-b6a6-bfa936accf4b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:42.709025 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-cdd4d0e9-b76a-456d-b6a6-bfa936accf4b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:42.715315 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cdd4d0e9-b76a-456d-b6a6-bfa936accf4b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:42.715761 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cdd4d0e9-b76a-456d-b6a6-bfa936accf4b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:42.717348 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cdd4d0e9-b76a-456d-b6a6-bfa936accf4b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:42.717805 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-cdd4d0e9-b76a-456d-b6a6-bfa936accf4b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:42.849257 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-cdd4d0e9-b76a-456d-b6a6-bfa936accf4b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:42.857550 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-cdd4d0e9-b76a-456d-b6a6-bfa936accf4b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:42.859076 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-cdd4d0e9-b76a-456d-b6a6-bfa936accf4b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:42.860260 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-cdd4d0e9-b76a-456d-b6a6-bfa936accf4b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1731 microversion: 2.20 time: 0.155810 Jun 03 10:04:42.860824 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 448/934] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:42 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:43.268685 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-271a53dc-4416-4fde-a564-fdd8728f9824 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:43.269540 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-271a53dc-4416-4fde-a564-fdd8728f9824 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:43.277164 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-271a53dc-4416-4fde-a564-fdd8728f9824 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:43.277613 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-271a53dc-4416-4fde-a564-fdd8728f9824 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:43.278414 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-271a53dc-4416-4fde-a564-fdd8728f9824 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:43.278884 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-271a53dc-4416-4fde-a564-fdd8728f9824 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:43.417404 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-271a53dc-4416-4fde-a564-fdd8728f9824 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:43.426325 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-271a53dc-4416-4fde-a564-fdd8728f9824 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1577 microversion: 2.1 time: 0.161913 Jun 03 10:04:43.426884 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 487/935] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:43 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:43.881126 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-9dbfbcea-5f59-4713-9906-78938db32759 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:43.882659 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-9dbfbcea-5f59-4713-9906-78938db32759 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:43.891032 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_api:SELECT=68 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:04:43.893111 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9dbfbcea-5f59-4713-9906-78938db32759 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:43.894167 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9dbfbcea-5f59-4713-9906-78938db32759 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:43.895731 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9dbfbcea-5f59-4713-9906-78938db32759 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:43.896317 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9dbfbcea-5f59-4713-9906-78938db32759 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:44.037733 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-9dbfbcea-5f59-4713-9906-78938db32759 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:44.046285 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-9dbfbcea-5f59-4713-9906-78938db32759 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:44.047803 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-9dbfbcea-5f59-4713-9906-78938db32759 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:44.048978 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-9dbfbcea-5f59-4713-9906-78938db32759 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1731 microversion: 2.20 time: 0.173148 Jun 03 10:04:44.049542 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 449/936] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:43 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:44.443717 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-41a2aeca-de50-4596-bcb4-5f2d3c4fd3da tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:44.444485 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-41a2aeca-de50-4596-bcb4-5f2d3c4fd3da tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:44.451461 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-41a2aeca-de50-4596-bcb4-5f2d3c4fd3da tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:44.452049 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-41a2aeca-de50-4596-bcb4-5f2d3c4fd3da tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:44.452952 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-41a2aeca-de50-4596-bcb4-5f2d3c4fd3da tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:44.453495 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-41a2aeca-de50-4596-bcb4-5f2d3c4fd3da tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:44.589569 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-41a2aeca-de50-4596-bcb4-5f2d3c4fd3da tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:44.597379 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-41a2aeca-de50-4596-bcb4-5f2d3c4fd3da tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1577 microversion: 2.1 time: 0.157407 Jun 03 10:04:44.598002 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 488/937] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:44 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:45.067255 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-1a0d37dd-8b89-4566-9636-8324eaf5b320 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:45.067879 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-1a0d37dd-8b89-4566-9636-8324eaf5b320 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:45.074551 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1a0d37dd-8b89-4566-9636-8324eaf5b320 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:45.075000 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1a0d37dd-8b89-4566-9636-8324eaf5b320 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:45.076293 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1a0d37dd-8b89-4566-9636-8324eaf5b320 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:45.076729 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1a0d37dd-8b89-4566-9636-8324eaf5b320 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:45.224373 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-1a0d37dd-8b89-4566-9636-8324eaf5b320 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:45.233218 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-1a0d37dd-8b89-4566-9636-8324eaf5b320 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:45.234841 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-1a0d37dd-8b89-4566-9636-8324eaf5b320 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:45.236258 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-1a0d37dd-8b89-4566-9636-8324eaf5b320 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1731 microversion: 2.20 time: 0.172932 Jun 03 10:04:45.236841 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 450/938] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:45 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:45.614264 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-d84f27da-5819-49ed-a941-7b1c54ef96e3 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:45.614877 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-d84f27da-5819-49ed-a941-7b1c54ef96e3 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:45.617372 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_api:SELECT=68 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:04:45.623258 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d84f27da-5819-49ed-a941-7b1c54ef96e3 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:45.623718 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d84f27da-5819-49ed-a941-7b1c54ef96e3 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:45.624492 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d84f27da-5819-49ed-a941-7b1c54ef96e3 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:45.624929 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d84f27da-5819-49ed-a941-7b1c54ef96e3 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:45.763401 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-d84f27da-5819-49ed-a941-7b1c54ef96e3 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:45.771621 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-d84f27da-5819-49ed-a941-7b1c54ef96e3 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1577 microversion: 2.1 time: 0.161153 Jun 03 10:04:45.781262 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 489/939] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:45 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1577 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:46.254372 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-302b0630-5a77-48b6-a0d0-2baf92f5b7de tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:46.255194 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-302b0630-5a77-48b6-a0d0-2baf92f5b7de tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:46.262051 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-302b0630-5a77-48b6-a0d0-2baf92f5b7de tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:46.262508 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-302b0630-5a77-48b6-a0d0-2baf92f5b7de tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:46.263323 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-302b0630-5a77-48b6-a0d0-2baf92f5b7de tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:46.263771 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-302b0630-5a77-48b6-a0d0-2baf92f5b7de tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:46.421051 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-302b0630-5a77-48b6-a0d0-2baf92f5b7de tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:46.429306 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-302b0630-5a77-48b6-a0d0-2baf92f5b7de tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:46.431109 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-302b0630-5a77-48b6-a0d0-2baf92f5b7de tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:46.432495 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-302b0630-5a77-48b6-a0d0-2baf92f5b7de tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1731 microversion: 2.20 time: 0.182098 Jun 03 10:04:46.433228 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 451/940] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:46 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1731 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:46.789049 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-cd0499a8-a01d-4870-9446-63bc375b1ea9 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:46.789606 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-cd0499a8-a01d-4870-9446-63bc375b1ea9 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:46.796889 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cd0499a8-a01d-4870-9446-63bc375b1ea9 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:46.797340 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cd0499a8-a01d-4870-9446-63bc375b1ea9 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:46.798223 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cd0499a8-a01d-4870-9446-63bc375b1ea9 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:46.798667 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cd0499a8-a01d-4870-9446-63bc375b1ea9 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:46.931727 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-cd0499a8-a01d-4870-9446-63bc375b1ea9 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:46.939755 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-cd0499a8-a01d-4870-9446-63bc375b1ea9 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1577 microversion: 2.1 time: 0.154939 Jun 03 10:04:46.940333 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 490/941] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:46 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:47.452891 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-fb7c5728-7614-4626-b571-3bac93ff1b49 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:47.453526 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-fb7c5728-7614-4626-b571-3bac93ff1b49 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:47.460248 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fb7c5728-7614-4626-b571-3bac93ff1b49 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:47.460693 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fb7c5728-7614-4626-b571-3bac93ff1b49 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:47.461468 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fb7c5728-7614-4626-b571-3bac93ff1b49 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:47.461935 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fb7c5728-7614-4626-b571-3bac93ff1b49 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:47.596212 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-fb7c5728-7614-4626-b571-3bac93ff1b49 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:47.604401 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-fb7c5728-7614-4626-b571-3bac93ff1b49 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:47.605947 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-fb7c5728-7614-4626-b571-3bac93ff1b49 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:47.607119 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-fb7c5728-7614-4626-b571-3bac93ff1b49 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1731 microversion: 2.20 time: 0.158703 Jun 03 10:04:47.607873 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 452/942] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:47 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 10:04:47.956968 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-283a71d2-93ca-4e27-8cb0-05edbcfafcdc tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:47.957653 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-283a71d2-93ca-4e27-8cb0-05edbcfafcdc tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:47.964213 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-283a71d2-93ca-4e27-8cb0-05edbcfafcdc tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:47.964668 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-283a71d2-93ca-4e27-8cb0-05edbcfafcdc tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:47.965451 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-283a71d2-93ca-4e27-8cb0-05edbcfafcdc tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:47.965929 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-283a71d2-93ca-4e27-8cb0-05edbcfafcdc tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:48.104992 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-283a71d2-93ca-4e27-8cb0-05edbcfafcdc tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:48.113085 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-283a71d2-93ca-4e27-8cb0-05edbcfafcdc tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1577 microversion: 2.1 time: 0.159998 Jun 03 10:04:48.113658 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 491/943] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:47 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1577 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:48.625662 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-a6412a5a-b0c4-418e-86ac-20ba8080e66f tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:48.626239 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-a6412a5a-b0c4-418e-86ac-20ba8080e66f tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:48.632792 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a6412a5a-b0c4-418e-86ac-20ba8080e66f tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:48.633245 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a6412a5a-b0c4-418e-86ac-20ba8080e66f tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:48.634032 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a6412a5a-b0c4-418e-86ac-20ba8080e66f tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:48.634471 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a6412a5a-b0c4-418e-86ac-20ba8080e66f tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:48.769403 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-a6412a5a-b0c4-418e-86ac-20ba8080e66f tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:48.777925 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-a6412a5a-b0c4-418e-86ac-20ba8080e66f tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:48.779986 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-a6412a5a-b0c4-418e-86ac-20ba8080e66f tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:48.781153 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-a6412a5a-b0c4-418e-86ac-20ba8080e66f tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1731 microversion: 2.20 time: 0.159472 Jun 03 10:04:48.781922 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 453/944] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:48 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:49.130662 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-f27b9a3d-b1a1-4942-9cdf-b690029c255a tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:49.131290 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-f27b9a3d-b1a1-4942-9cdf-b690029c255a tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:49.139062 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f27b9a3d-b1a1-4942-9cdf-b690029c255a tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:49.139574 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f27b9a3d-b1a1-4942-9cdf-b690029c255a tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:49.140918 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f27b9a3d-b1a1-4942-9cdf-b690029c255a tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:49.141519 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f27b9a3d-b1a1-4942-9cdf-b690029c255a tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:49.300123 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-f27b9a3d-b1a1-4942-9cdf-b690029c255a tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:49.308235 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-f27b9a3d-b1a1-4942-9cdf-b690029c255a tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1577 microversion: 2.1 time: 0.181716 Jun 03 10:04:49.308837 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 492/945] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:49 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1577 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:49.799495 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-9f0b8509-2463-4c6b-9414-9247f0c57d58 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:49.800219 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-9f0b8509-2463-4c6b-9414-9247f0c57d58 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:49.806860 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9f0b8509-2463-4c6b-9414-9247f0c57d58 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:49.807310 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9f0b8509-2463-4c6b-9414-9247f0c57d58 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:49.808095 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9f0b8509-2463-4c6b-9414-9247f0c57d58 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:49.808525 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9f0b8509-2463-4c6b-9414-9247f0c57d58 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:49.943392 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-9f0b8509-2463-4c6b-9414-9247f0c57d58 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:49.952180 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-9f0b8509-2463-4c6b-9414-9247f0c57d58 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:49.953850 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-9f0b8509-2463-4c6b-9414-9247f0c57d58 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:49.955265 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-9f0b8509-2463-4c6b-9414-9247f0c57d58 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1731 microversion: 2.20 time: 0.159577 Jun 03 10:04:49.955932 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 454/946] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:49 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:50.326092 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-44fd98de-f820-4b90-8f69-3a40479591d0 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:50.327445 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-44fd98de-f820-4b90-8f69-3a40479591d0 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:50.334241 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-44fd98de-f820-4b90-8f69-3a40479591d0 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:50.334695 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-44fd98de-f820-4b90-8f69-3a40479591d0 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:50.335478 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-44fd98de-f820-4b90-8f69-3a40479591d0 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:50.335917 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-44fd98de-f820-4b90-8f69-3a40479591d0 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:50.480913 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-44fd98de-f820-4b90-8f69-3a40479591d0 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:50.489440 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-44fd98de-f820-4b90-8f69-3a40479591d0 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1577 microversion: 2.1 time: 0.167717 Jun 03 10:04:50.490268 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 493/947] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:50 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1577 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:50.973835 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-88a41d86-5672-4361-805c-b395f9867861 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:50.974511 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-88a41d86-5672-4361-805c-b395f9867861 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:50.982078 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-88a41d86-5672-4361-805c-b395f9867861 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:50.982571 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-88a41d86-5672-4361-805c-b395f9867861 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:50.983507 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-88a41d86-5672-4361-805c-b395f9867861 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:50.983975 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-88a41d86-5672-4361-805c-b395f9867861 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:51.123644 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-88a41d86-5672-4361-805c-b395f9867861 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:51.131521 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-88a41d86-5672-4361-805c-b395f9867861 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:51.133043 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-88a41d86-5672-4361-805c-b395f9867861 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:51.134208 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-88a41d86-5672-4361-805c-b395f9867861 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1731 microversion: 2.20 time: 0.164268 Jun 03 10:04:51.134777 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 455/948] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:50 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:51.507838 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-d4263ecb-933f-40c1-a8c0-0549993c8afb tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:51.508469 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-d4263ecb-933f-40c1-a8c0-0549993c8afb tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:51.516288 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d4263ecb-933f-40c1-a8c0-0549993c8afb tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:51.516918 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d4263ecb-933f-40c1-a8c0-0549993c8afb tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:51.517710 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d4263ecb-933f-40c1-a8c0-0549993c8afb tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:51.518192 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d4263ecb-933f-40c1-a8c0-0549993c8afb tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:51.662173 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-d4263ecb-933f-40c1-a8c0-0549993c8afb tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:51.664432 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:04:51.671698 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-d4263ecb-933f-40c1-a8c0-0549993c8afb tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1577 microversion: 2.1 time: 0.168386 Jun 03 10:04:51.672467 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 494/949] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:51 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1577 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:52.153189 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-feab32bc-9526-430b-b7f9-5805cc638f0a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:52.153978 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-feab32bc-9526-430b-b7f9-5805cc638f0a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:52.160476 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-feab32bc-9526-430b-b7f9-5805cc638f0a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:52.160922 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-feab32bc-9526-430b-b7f9-5805cc638f0a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:52.162708 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-feab32bc-9526-430b-b7f9-5805cc638f0a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:52.163268 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-feab32bc-9526-430b-b7f9-5805cc638f0a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:52.304132 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-feab32bc-9526-430b-b7f9-5805cc638f0a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:52.312453 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-feab32bc-9526-430b-b7f9-5805cc638f0a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:52.313975 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-feab32bc-9526-430b-b7f9-5805cc638f0a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:52.315118 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-feab32bc-9526-430b-b7f9-5805cc638f0a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1731 microversion: 2.20 time: 0.165838 Jun 03 10:04:52.315675 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 456/950] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:52 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:52.689393 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-f7283fd6-a3a1-4b20-929f-57f811646502 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:52.690187 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-f7283fd6-a3a1-4b20-929f-57f811646502 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:52.697930 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f7283fd6-a3a1-4b20-929f-57f811646502 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:52.698443 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f7283fd6-a3a1-4b20-929f-57f811646502 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:52.699161 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f7283fd6-a3a1-4b20-929f-57f811646502 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:52.699603 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f7283fd6-a3a1-4b20-929f-57f811646502 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:52.854853 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-f7283fd6-a3a1-4b20-929f-57f811646502 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:52.863685 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-f7283fd6-a3a1-4b20-929f-57f811646502 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1577 microversion: 2.1 time: 0.179004 Jun 03 10:04:52.873477 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 495/951] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:52 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1577 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:53.332604 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-336f9e16-62aa-45b4-8afa-586feea53362 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:53.333249 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-336f9e16-62aa-45b4-8afa-586feea53362 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:53.339903 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-336f9e16-62aa-45b4-8afa-586feea53362 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:53.340360 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-336f9e16-62aa-45b4-8afa-586feea53362 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:53.341123 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-336f9e16-62aa-45b4-8afa-586feea53362 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:53.342245 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-336f9e16-62aa-45b4-8afa-586feea53362 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:53.346196 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:04:53.473853 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-336f9e16-62aa-45b4-8afa-586feea53362 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:53.481658 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-336f9e16-62aa-45b4-8afa-586feea53362 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:53.483185 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-336f9e16-62aa-45b4-8afa-586feea53362 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:53.484373 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-336f9e16-62aa-45b4-8afa-586feea53362 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1731 microversion: 2.20 time: 0.155655 Jun 03 10:04:53.484931 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 457/952] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:53 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:53.880904 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-8cd92011-df7c-40ad-9137-e7ef08a70773 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:53.881517 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-8cd92011-df7c-40ad-9137-e7ef08a70773 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:53.888180 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8cd92011-df7c-40ad-9137-e7ef08a70773 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:53.888629 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8cd92011-df7c-40ad-9137-e7ef08a70773 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:53.889391 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8cd92011-df7c-40ad-9137-e7ef08a70773 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:53.890491 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8cd92011-df7c-40ad-9137-e7ef08a70773 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:54.017344 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-8cd92011-df7c-40ad-9137-e7ef08a70773 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:54.025959 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-8cd92011-df7c-40ad-9137-e7ef08a70773 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1577 microversion: 2.1 time: 0.148799 Jun 03 10:04:54.026545 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 496/953] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:53 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1577 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:54.501655 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-0f8f6653-f164-45e4-97f1-fc2e9c5614d2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:54.502286 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-0f8f6653-f164-45e4-97f1-fc2e9c5614d2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:54.508735 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0f8f6653-f164-45e4-97f1-fc2e9c5614d2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:54.509171 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0f8f6653-f164-45e4-97f1-fc2e9c5614d2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:54.509960 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0f8f6653-f164-45e4-97f1-fc2e9c5614d2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:54.510393 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0f8f6653-f164-45e4-97f1-fc2e9c5614d2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:54.637254 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-0f8f6653-f164-45e4-97f1-fc2e9c5614d2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:54.645803 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-0f8f6653-f164-45e4-97f1-fc2e9c5614d2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:54.647225 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-0f8f6653-f164-45e4-97f1-fc2e9c5614d2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:54.648362 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-0f8f6653-f164-45e4-97f1-fc2e9c5614d2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1731 microversion: 2.20 time: 0.150590 Jun 03 10:04:54.648922 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 458/954] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:54 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:55.043506 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-e088a5a8-4585-4369-8086-948012458b23 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:55.044119 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-e088a5a8-4585-4369-8086-948012458b23 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:55.051188 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e088a5a8-4585-4369-8086-948012458b23 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:55.051637 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e088a5a8-4585-4369-8086-948012458b23 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:55.052468 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e088a5a8-4585-4369-8086-948012458b23 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:55.052907 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e088a5a8-4585-4369-8086-948012458b23 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:55.189407 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-e088a5a8-4585-4369-8086-948012458b23 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:55.196935 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-e088a5a8-4585-4369-8086-948012458b23 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1577 microversion: 2.1 time: 0.157311 Jun 03 10:04:55.197493 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 497/955] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:55 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:55.666140 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-a186b388-a235-4441-a790-15a7eb197423 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:55.666694 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-a186b388-a235-4441-a790-15a7eb197423 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:55.674002 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a186b388-a235-4441-a790-15a7eb197423 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:55.674455 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a186b388-a235-4441-a790-15a7eb197423 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:55.675220 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a186b388-a235-4441-a790-15a7eb197423 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:55.675657 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a186b388-a235-4441-a790-15a7eb197423 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:55.802190 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-a186b388-a235-4441-a790-15a7eb197423 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:55.810004 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-a186b388-a235-4441-a790-15a7eb197423 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:55.811512 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-a186b388-a235-4441-a790-15a7eb197423 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:55.812723 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-a186b388-a235-4441-a790-15a7eb197423 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1731 microversion: 2.20 time: 0.150847 Jun 03 10:04:55.813543 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 459/956] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:55 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:56.213676 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-b89a1eac-0ef0-469d-9860-2e86448d26ec tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:56.214392 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-b89a1eac-0ef0-469d-9860-2e86448d26ec tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:56.221075 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b89a1eac-0ef0-469d-9860-2e86448d26ec tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:56.221527 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b89a1eac-0ef0-469d-9860-2e86448d26ec tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:56.222338 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b89a1eac-0ef0-469d-9860-2e86448d26ec tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:56.222780 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b89a1eac-0ef0-469d-9860-2e86448d26ec tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:56.367326 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-b89a1eac-0ef0-469d-9860-2e86448d26ec tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:56.375385 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-b89a1eac-0ef0-469d-9860-2e86448d26ec tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1577 microversion: 2.1 time: 0.165101 Jun 03 10:04:56.375972 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 498/957] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:56 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:56.831789 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-72ccd7e9-566c-4871-a601-a9c15ae1b2b9 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:56.833086 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-72ccd7e9-566c-4871-a601-a9c15ae1b2b9 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:56.841042 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-72ccd7e9-566c-4871-a601-a9c15ae1b2b9 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:56.841763 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-72ccd7e9-566c-4871-a601-a9c15ae1b2b9 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:56.842751 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-72ccd7e9-566c-4871-a601-a9c15ae1b2b9 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:56.843185 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-72ccd7e9-566c-4871-a601-a9c15ae1b2b9 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:57.000737 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-72ccd7e9-566c-4871-a601-a9c15ae1b2b9 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:57.010220 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-72ccd7e9-566c-4871-a601-a9c15ae1b2b9 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:57.012013 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-72ccd7e9-566c-4871-a601-a9c15ae1b2b9 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:57.013200 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-72ccd7e9-566c-4871-a601-a9c15ae1b2b9 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1731 microversion: 2.20 time: 0.185506 Jun 03 10:04:57.014111 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 460/958] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:56 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1731 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:57.393472 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-09ca2f80-32af-47ad-8bdc-4d899c51c942 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:57.393472 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-09ca2f80-32af-47ad-8bdc-4d899c51c942 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:57.403765 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-09ca2f80-32af-47ad-8bdc-4d899c51c942 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:57.404214 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-09ca2f80-32af-47ad-8bdc-4d899c51c942 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:57.404993 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-09ca2f80-32af-47ad-8bdc-4d899c51c942 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:57.405433 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-09ca2f80-32af-47ad-8bdc-4d899c51c942 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:57.540116 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-09ca2f80-32af-47ad-8bdc-4d899c51c942 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:57.547643 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-09ca2f80-32af-47ad-8bdc-4d899c51c942 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1577 microversion: 2.1 time: 0.159258 Jun 03 10:04:57.548211 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 499/959] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:57 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1577 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:58.031816 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-1d647bbf-d16a-4264-85d6-1176a30faa39 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:58.032417 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-1d647bbf-d16a-4264-85d6-1176a30faa39 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:58.039269 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1d647bbf-d16a-4264-85d6-1176a30faa39 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:58.039718 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1d647bbf-d16a-4264-85d6-1176a30faa39 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:58.040474 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1d647bbf-d16a-4264-85d6-1176a30faa39 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:58.040904 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1d647bbf-d16a-4264-85d6-1176a30faa39 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:58.176923 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-1d647bbf-d16a-4264-85d6-1176a30faa39 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:58.184818 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-1d647bbf-d16a-4264-85d6-1176a30faa39 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:58.186327 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-1d647bbf-d16a-4264-85d6-1176a30faa39 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:58.188144 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-1d647bbf-d16a-4264-85d6-1176a30faa39 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1731 microversion: 2.20 time: 0.159781 Jun 03 10:04:58.188702 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 461/960] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:58 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:58.564122 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-c79a6cf3-3913-42be-b70e-eaf40a88df6b tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:58.564766 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-c79a6cf3-3913-42be-b70e-eaf40a88df6b tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:58.571282 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c79a6cf3-3913-42be-b70e-eaf40a88df6b tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:58.571730 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c79a6cf3-3913-42be-b70e-eaf40a88df6b tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:58.572492 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c79a6cf3-3913-42be-b70e-eaf40a88df6b tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:58.572929 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c79a6cf3-3913-42be-b70e-eaf40a88df6b tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:58.699917 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-c79a6cf3-3913-42be-b70e-eaf40a88df6b tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:58.707358 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-c79a6cf3-3913-42be-b70e-eaf40a88df6b tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1577 microversion: 2.1 time: 0.147192 Jun 03 10:04:58.707927 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 500/961] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:58 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1577 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:04:59.206762 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-00099997-d010-488f-a76f-3d5a3844fc0f tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:59.207376 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-00099997-d010-488f-a76f-3d5a3844fc0f tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:59.213970 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-00099997-d010-488f-a76f-3d5a3844fc0f tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:59.214428 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-00099997-d010-488f-a76f-3d5a3844fc0f tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:59.215203 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-00099997-d010-488f-a76f-3d5a3844fc0f tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:59.215718 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-00099997-d010-488f-a76f-3d5a3844fc0f tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:59.289073 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-2d2daa95-117d-46f5-8ab8-b41dce6fab37 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:59.289576 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-2d2daa95-117d-46f5-8ab8-b41dce6fab37 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: c0b58286-60ef-44eb-8e6b-e8050e695532] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:59.296121 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2d2daa95-117d-46f5-8ab8-b41dce6fab37 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:59.296426 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2d2daa95-117d-46f5-8ab8-b41dce6fab37 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:59.297437 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2d2daa95-117d-46f5-8ab8-b41dce6fab37 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:59.297923 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2d2daa95-117d-46f5-8ab8-b41dce6fab37 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:59.332768 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-2d2daa95-117d-46f5-8ab8-b41dce6fab37 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532/ips" status: 200 len: 151 microversion: 2.1 time: 0.047853 Jun 03 10:04:59.338560 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 501/962] 10.222.0.45 () {58 vars in 1247 bytes} [Fri Jun 3 10:04:59 2022] GET /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532/ips => generated 151 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 10:04:59.360165 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-00099997-d010-488f-a76f-3d5a3844fc0f tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:59.370094 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-00099997-d010-488f-a76f-3d5a3844fc0f tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:59.372950 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-00099997-d010-488f-a76f-3d5a3844fc0f tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:59.385518 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-00099997-d010-488f-a76f-3d5a3844fc0f tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1731 microversion: 2.20 time: 0.172362 Jun 03 10:04:59.386792 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 462/963] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:04:59 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1731 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:04:59.723706 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-3cfbe0f4-de76-4e3d-bce4-f88b2389ac4b tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:04:59.724321 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-3cfbe0f4-de76-4e3d-bce4-f88b2389ac4b tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:04:59.730782 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3cfbe0f4-de76-4e3d-bce4-f88b2389ac4b tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:59.731232 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3cfbe0f4-de76-4e3d-bce4-f88b2389ac4b tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:59.731992 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3cfbe0f4-de76-4e3d-bce4-f88b2389ac4b tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:04:59.732428 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3cfbe0f4-de76-4e3d-bce4-f88b2389ac4b tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:04:59.859842 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-3cfbe0f4-de76-4e3d-bce4-f88b2389ac4b tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:04:59.867213 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-3cfbe0f4-de76-4e3d-bce4-f88b2389ac4b tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1577 microversion: 2.1 time: 0.147482 Jun 03 10:04:59.867765 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 502/964] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:04:59 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1577 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:05:00.404509 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-15d6fc4b-523f-4a94-8d7c-6acd453af7d2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:00.405118 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-15d6fc4b-523f-4a94-8d7c-6acd453af7d2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:00.412560 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-15d6fc4b-523f-4a94-8d7c-6acd453af7d2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:00.413004 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-15d6fc4b-523f-4a94-8d7c-6acd453af7d2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:00.413895 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-15d6fc4b-523f-4a94-8d7c-6acd453af7d2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:00.414443 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-15d6fc4b-523f-4a94-8d7c-6acd453af7d2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:00.554288 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-15d6fc4b-523f-4a94-8d7c-6acd453af7d2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:00.562678 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-15d6fc4b-523f-4a94-8d7c-6acd453af7d2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:00.564217 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-15d6fc4b-523f-4a94-8d7c-6acd453af7d2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:00.565382 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-15d6fc4b-523f-4a94-8d7c-6acd453af7d2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1731 microversion: 2.20 time: 0.164804 Jun 03 10:05:00.565997 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 463/965] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:05:00 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:05:00.666935 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-616b6c07-21ad-4f11-a7cc-39ee8a27cdd9 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c035c358-1fd9-4a71-942e-a73249591ede"}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:05:00.668015 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-616b6c07-21ad-4f11-a7cc-39ee8a27cdd9 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: c0b58286-60ef-44eb-8e6b-e8050e695532] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:00.674165 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-616b6c07-21ad-4f11-a7cc-39ee8a27cdd9 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:00.674618 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-616b6c07-21ad-4f11-a7cc-39ee8a27cdd9 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:00.675381 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-616b6c07-21ad-4f11-a7cc-39ee8a27cdd9 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:00.675821 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-616b6c07-21ad-4f11-a7cc-39ee8a27cdd9 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:00.884607 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-589ce7a3-9a55-4fc7-983b-286488b93b7d tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:00.885806 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-589ce7a3-9a55-4fc7-983b-286488b93b7d tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:00.892567 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-589ce7a3-9a55-4fc7-983b-286488b93b7d tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:00.893017 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-589ce7a3-9a55-4fc7-983b-286488b93b7d tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:00.893809 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-589ce7a3-9a55-4fc7-983b-286488b93b7d tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:00.894282 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-589ce7a3-9a55-4fc7-983b-286488b93b7d tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:01.039273 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-589ce7a3-9a55-4fc7-983b-286488b93b7d tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:01.049146 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-589ce7a3-9a55-4fc7-983b-286488b93b7d tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1577 microversion: 2.1 time: 0.168399 Jun 03 10:05:01.050016 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 464/966] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:00 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1577 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:01.158559 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-616b6c07-21ad-4f11-a7cc-39ee8a27cdd9 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "POST /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.495459 Jun 03 10:05:01.159300 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 503/967] 10.222.0.45 () {60 vars in 1322 bytes} [Fri Jun 3 10:05:00 2022] POST /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532/os-volume_attachments => generated 194 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:05:01.584083 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-d9952995-9a8b-4323-a0c7-5ba35a8e28c0 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:01.584713 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-d9952995-9a8b-4323-a0c7-5ba35a8e28c0 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:01.591355 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d9952995-9a8b-4323-a0c7-5ba35a8e28c0 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:01.591809 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d9952995-9a8b-4323-a0c7-5ba35a8e28c0 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:01.592580 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d9952995-9a8b-4323-a0c7-5ba35a8e28c0 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:01.593026 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d9952995-9a8b-4323-a0c7-5ba35a8e28c0 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:01.725994 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d9952995-9a8b-4323-a0c7-5ba35a8e28c0 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:01.733928 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d9952995-9a8b-4323-a0c7-5ba35a8e28c0 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:01.735951 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d9952995-9a8b-4323-a0c7-5ba35a8e28c0 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:01.737111 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-d9952995-9a8b-4323-a0c7-5ba35a8e28c0 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1731 microversion: 2.20 time: 0.156947 Jun 03 10:05:01.737697 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 465/968] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:05:01 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:05:02.067135 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-90a4c3d3-3296-45cd-a4c2-af3386989144 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:02.067758 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-90a4c3d3-3296-45cd-a4c2-af3386989144 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:02.074120 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-90a4c3d3-3296-45cd-a4c2-af3386989144 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:02.074580 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-90a4c3d3-3296-45cd-a4c2-af3386989144 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:02.075336 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-90a4c3d3-3296-45cd-a4c2-af3386989144 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:02.075772 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-90a4c3d3-3296-45cd-a4c2-af3386989144 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:02.206545 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-90a4c3d3-3296-45cd-a4c2-af3386989144 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:02.213912 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-90a4c3d3-3296-45cd-a4c2-af3386989144 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1577 microversion: 2.1 time: 0.152284 Jun 03 10:05:02.214478 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 504/969] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:02 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:02.755445 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-d0adefb1-7066-49a4-ad0e-f5e161bcaae1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:02.756050 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-d0adefb1-7066-49a4-ad0e-f5e161bcaae1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:02.762538 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d0adefb1-7066-49a4-ad0e-f5e161bcaae1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:02.762982 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d0adefb1-7066-49a4-ad0e-f5e161bcaae1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:02.763741 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d0adefb1-7066-49a4-ad0e-f5e161bcaae1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:02.764174 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d0adefb1-7066-49a4-ad0e-f5e161bcaae1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:02.898795 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d0adefb1-7066-49a4-ad0e-f5e161bcaae1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:02.906608 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d0adefb1-7066-49a4-ad0e-f5e161bcaae1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:02.908095 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d0adefb1-7066-49a4-ad0e-f5e161bcaae1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:02.909237 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-d0adefb1-7066-49a4-ad0e-f5e161bcaae1 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1731 microversion: 2.20 time: 0.157669 Jun 03 10:05:02.909809 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 466/970] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:05:02 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 10:05:03.230798 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-9da23924-4f57-4bf7-8eb0-fc597189bf60 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:03.231415 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-9da23924-4f57-4bf7-8eb0-fc597189bf60 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:03.238507 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9da23924-4f57-4bf7-8eb0-fc597189bf60 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:03.238958 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9da23924-4f57-4bf7-8eb0-fc597189bf60 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:03.239718 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9da23924-4f57-4bf7-8eb0-fc597189bf60 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:03.240156 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9da23924-4f57-4bf7-8eb0-fc597189bf60 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:03.372983 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-9da23924-4f57-4bf7-8eb0-fc597189bf60 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:03.381226 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-9da23924-4f57-4bf7-8eb0-fc597189bf60 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1577 microversion: 2.1 time: 0.154293 Jun 03 10:05:03.381808 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 505/971] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:03 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:03.928095 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-0a2344fe-396e-44e2-87f4-71600329092c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:03.928662 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-0a2344fe-396e-44e2-87f4-71600329092c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:03.935199 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0a2344fe-396e-44e2-87f4-71600329092c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:03.935643 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0a2344fe-396e-44e2-87f4-71600329092c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:03.936401 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0a2344fe-396e-44e2-87f4-71600329092c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:03.936831 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0a2344fe-396e-44e2-87f4-71600329092c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:04.063916 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-0a2344fe-396e-44e2-87f4-71600329092c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:04.071617 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-0a2344fe-396e-44e2-87f4-71600329092c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:04.073105 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-0a2344fe-396e-44e2-87f4-71600329092c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:04.074280 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-0a2344fe-396e-44e2-87f4-71600329092c tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1731 microversion: 2.20 time: 0.150233 Jun 03 10:05:04.074837 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 467/972] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:05:03 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:05:04.398659 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-11e2b863-910f-49ec-9369-7016fe3f0649 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:04.399274 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-11e2b863-910f-49ec-9369-7016fe3f0649 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:04.405856 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-11e2b863-910f-49ec-9369-7016fe3f0649 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:04.406303 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-11e2b863-910f-49ec-9369-7016fe3f0649 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:04.407064 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-11e2b863-910f-49ec-9369-7016fe3f0649 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:04.407504 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-11e2b863-910f-49ec-9369-7016fe3f0649 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:04.539637 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-11e2b863-910f-49ec-9369-7016fe3f0649 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:04.547146 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-11e2b863-910f-49ec-9369-7016fe3f0649 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1577 microversion: 2.1 time: 0.152431 Jun 03 10:05:04.547716 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 506/973] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:04 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1577 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:05.092451 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-9fc46674-ff95-4383-bb35-67f5476d1342 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:05.093060 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-9fc46674-ff95-4383-bb35-67f5476d1342 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:05.100122 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9fc46674-ff95-4383-bb35-67f5476d1342 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:05.100567 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9fc46674-ff95-4383-bb35-67f5476d1342 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:05.101331 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9fc46674-ff95-4383-bb35-67f5476d1342 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:05.101780 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9fc46674-ff95-4383-bb35-67f5476d1342 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:05.232082 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-9fc46674-ff95-4383-bb35-67f5476d1342 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:05.240433 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-9fc46674-ff95-4383-bb35-67f5476d1342 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:05.241963 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-9fc46674-ff95-4383-bb35-67f5476d1342 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:05.243105 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-9fc46674-ff95-4383-bb35-67f5476d1342 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1731 microversion: 2.20 time: 0.154610 Jun 03 10:05:05.243666 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 468/974] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:05:05 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:05:05.560260 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-d59db33f-7756-4ab4-a03d-93baa2bddbf0 req-4e3d3f89-92fb-49c5-bc42-a3a7f4300ef0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a0aa280-d0b4-42e3-8dd4-e222a70d0f10", "name": "network-vif-plugged", "status": "completed", "tag": "11ea2cd5-6468-4db5-8bec-8a0e6b1acff8"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:05:05.568613 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-0b090f86-afd3-49eb-be39-94acf80a8137 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:05.568786 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-d59db33f-7756-4ab4-a03d-93baa2bddbf0 req-4e3d3f89-92fb-49c5-bc42-a3a7f4300ef0 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:05.569174 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-d59db33f-7756-4ab4-a03d-93baa2bddbf0 req-4e3d3f89-92fb-49c5-bc42-a3a7f4300ef0 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:05.570461 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-0b090f86-afd3-49eb-be39-94acf80a8137 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:05.582538 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-d59db33f-7756-4ab4-a03d-93baa2bddbf0 req-4e3d3f89-92fb-49c5-bc42-a3a7f4300ef0 service nova] Creating event network-vif-plugged:11ea2cd5-6468-4db5-8bec-8a0e6b1acff8 for instance 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 on hv-cinder-79760 Jun 03 10:05:05.583996 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0b090f86-afd3-49eb-be39-94acf80a8137 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:05.584825 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0b090f86-afd3-49eb-be39-94acf80a8137 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:05.586645 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0b090f86-afd3-49eb-be39-94acf80a8137 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:05.587103 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0b090f86-afd3-49eb-be39-94acf80a8137 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:05.587804 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-d59db33f-7756-4ab4-a03d-93baa2bddbf0 req-4e3d3f89-92fb-49c5-bc42-a3a7f4300ef0 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032836 Jun 03 10:05:05.589300 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 507/975] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:05:05.735715 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-0b090f86-afd3-49eb-be39-94acf80a8137 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:05.743386 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-0b090f86-afd3-49eb-be39-94acf80a8137 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1577 microversion: 2.1 time: 0.181979 Jun 03 10:05:05.744005 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 469/976] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:05 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1577 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:06.263362 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-bfdc3cb6-d866-46b7-a69e-020100ebef19 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:06.264209 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-bfdc3cb6-d866-46b7-a69e-020100ebef19 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:06.272541 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bfdc3cb6-d866-46b7-a69e-020100ebef19 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:06.273006 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bfdc3cb6-d866-46b7-a69e-020100ebef19 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:06.273805 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bfdc3cb6-d866-46b7-a69e-020100ebef19 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:06.274248 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bfdc3cb6-d866-46b7-a69e-020100ebef19 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:06.627071 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-bfdc3cb6-d866-46b7-a69e-020100ebef19 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:06.634939 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-bfdc3cb6-d866-46b7-a69e-020100ebef19 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:06.636429 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-bfdc3cb6-d866-46b7-a69e-020100ebef19 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:06.637578 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-bfdc3cb6-d866-46b7-a69e-020100ebef19 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1731 microversion: 2.20 time: 0.378631 Jun 03 10:05:06.638170 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 508/977] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:05:06 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1731 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 10:05:06.760202 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-90ffcf1a-9ba0-4bb1-b43e-7dd46ec4f372 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:06.760821 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-90ffcf1a-9ba0-4bb1-b43e-7dd46ec4f372 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:06.767909 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-90ffcf1a-9ba0-4bb1-b43e-7dd46ec4f372 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:06.768357 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-90ffcf1a-9ba0-4bb1-b43e-7dd46ec4f372 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:06.769114 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-90ffcf1a-9ba0-4bb1-b43e-7dd46ec4f372 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:06.769553 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-90ffcf1a-9ba0-4bb1-b43e-7dd46ec4f372 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:06.902790 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-90ffcf1a-9ba0-4bb1-b43e-7dd46ec4f372 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:06.910268 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-90ffcf1a-9ba0-4bb1-b43e-7dd46ec4f372 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1577 microversion: 2.1 time: 0.153939 Jun 03 10:05:06.910846 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 470/978] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:06 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:07.610501 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-c79797dc-5bd5-41ff-95e7-87cdba3490ca req-dcdc6513-a213-45b0-b9ae-21f0c68cb526 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02de8459-bf38-485f-971a-d8f1d7909898", "name": "network-vif-plugged", "status": "completed", "tag": "5b00cee1-834c-4ff1-b027-9118ca362265"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:05:07.619246 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-c79797dc-5bd5-41ff-95e7-87cdba3490ca req-dcdc6513-a213-45b0-b9ae-21f0c68cb526 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:07.619690 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-c79797dc-5bd5-41ff-95e7-87cdba3490ca req-dcdc6513-a213-45b0-b9ae-21f0c68cb526 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:07.630392 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-c79797dc-5bd5-41ff-95e7-87cdba3490ca req-dcdc6513-a213-45b0-b9ae-21f0c68cb526 service nova] Creating event network-vif-plugged:5b00cee1-834c-4ff1-b027-9118ca362265 for instance 02de8459-bf38-485f-971a-d8f1d7909898 on hv-cinder-79760 Jun 03 10:05:07.635289 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-c79797dc-5bd5-41ff-95e7-87cdba3490ca req-dcdc6513-a213-45b0-b9ae-21f0c68cb526 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029806 Jun 03 10:05:07.635865 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 509/979] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:05:07.655143 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-5bf1d057-758e-4cb9-b80f-591c4f83fe3e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:07.655749 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-5bf1d057-758e-4cb9-b80f-591c4f83fe3e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:07.662596 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5bf1d057-758e-4cb9-b80f-591c4f83fe3e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:07.663040 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5bf1d057-758e-4cb9-b80f-591c4f83fe3e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:07.663798 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5bf1d057-758e-4cb9-b80f-591c4f83fe3e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:07.664228 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-5bf1d057-758e-4cb9-b80f-591c4f83fe3e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:07.794996 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-5bf1d057-758e-4cb9-b80f-591c4f83fe3e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:07.802996 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-5bf1d057-758e-4cb9-b80f-591c4f83fe3e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:07.804484 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-5bf1d057-758e-4cb9-b80f-591c4f83fe3e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:07.805635 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-5bf1d057-758e-4cb9-b80f-591c4f83fe3e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1731 microversion: 2.20 time: 0.154304 Jun 03 10:05:07.806209 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 471/980] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:05:07 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:05:07.927293 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-af169bc2-73a1-4eef-a941-df4da0841656 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:07.927905 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-af169bc2-73a1-4eef-a941-df4da0841656 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:07.934422 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-af169bc2-73a1-4eef-a941-df4da0841656 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:07.934875 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-af169bc2-73a1-4eef-a941-df4da0841656 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:07.935641 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-af169bc2-73a1-4eef-a941-df4da0841656 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:07.936081 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-af169bc2-73a1-4eef-a941-df4da0841656 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:08.064866 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-af169bc2-73a1-4eef-a941-df4da0841656 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:08.072350 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-af169bc2-73a1-4eef-a941-df4da0841656 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1577 microversion: 2.1 time: 0.149330 Jun 03 10:05:08.072911 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 510/981] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:07 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1577 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:08.823070 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-135d03aa-6a88-4a6c-9965-ea63af5d4c40 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:08.823679 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-135d03aa-6a88-4a6c-9965-ea63af5d4c40 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:08.830250 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-135d03aa-6a88-4a6c-9965-ea63af5d4c40 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:08.830691 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-135d03aa-6a88-4a6c-9965-ea63af5d4c40 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:08.831450 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-135d03aa-6a88-4a6c-9965-ea63af5d4c40 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:08.831881 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-135d03aa-6a88-4a6c-9965-ea63af5d4c40 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:08.959831 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-135d03aa-6a88-4a6c-9965-ea63af5d4c40 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:08.967756 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-135d03aa-6a88-4a6c-9965-ea63af5d4c40 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:08.969323 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-135d03aa-6a88-4a6c-9965-ea63af5d4c40 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:08.971130 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-135d03aa-6a88-4a6c-9965-ea63af5d4c40 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1731 microversion: 2.20 time: 0.152036 Jun 03 10:05:08.971681 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 472/982] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:05:08 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:05:09.090104 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-3e92d5d2-fa3f-470e-a590-a6f451c447ee tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:09.090763 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-3e92d5d2-fa3f-470e-a590-a6f451c447ee tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:09.098320 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3e92d5d2-fa3f-470e-a590-a6f451c447ee tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:09.098771 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3e92d5d2-fa3f-470e-a590-a6f451c447ee tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:09.099830 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3e92d5d2-fa3f-470e-a590-a6f451c447ee tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:09.100273 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3e92d5d2-fa3f-470e-a590-a6f451c447ee tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:09.230843 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-3e92d5d2-fa3f-470e-a590-a6f451c447ee tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:09.233158 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:05:09.240242 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-3e92d5d2-fa3f-470e-a590-a6f451c447ee tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1577 microversion: 2.1 time: 0.154209 Jun 03 10:05:09.240801 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 511/983] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:09 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1577 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:09.989063 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-1e21e935-7555-456d-bb0c-580f3f0a0c13 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:09.989707 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-1e21e935-7555-456d-bb0c-580f3f0a0c13 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:09.996239 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1e21e935-7555-456d-bb0c-580f3f0a0c13 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:09.996686 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1e21e935-7555-456d-bb0c-580f3f0a0c13 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:09.997452 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1e21e935-7555-456d-bb0c-580f3f0a0c13 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:09.997917 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1e21e935-7555-456d-bb0c-580f3f0a0c13 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:10.130246 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-1e21e935-7555-456d-bb0c-580f3f0a0c13 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:10.132547 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell1:SELECT=100 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:05:10.139698 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-1e21e935-7555-456d-bb0c-580f3f0a0c13 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:10.141208 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-1e21e935-7555-456d-bb0c-580f3f0a0c13 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:10.142474 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-1e21e935-7555-456d-bb0c-580f3f0a0c13 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1731 microversion: 2.20 time: 0.157888 Jun 03 10:05:10.143036 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 473/984] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:05:09 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:05:10.257938 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-c332d454-907e-436b-8820-11e771b3650a tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:10.258550 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-c332d454-907e-436b-8820-11e771b3650a tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:10.265847 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c332d454-907e-436b-8820-11e771b3650a tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:10.266300 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c332d454-907e-436b-8820-11e771b3650a tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:10.267066 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c332d454-907e-436b-8820-11e771b3650a tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:10.267501 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c332d454-907e-436b-8820-11e771b3650a tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:10.398568 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-c332d454-907e-436b-8820-11e771b3650a tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:10.406116 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-c332d454-907e-436b-8820-11e771b3650a tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1577 microversion: 2.1 time: 0.152321 Jun 03 10:05:10.406674 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 512/985] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:10 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1577 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:11.160758 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-77a751e3-07f7-4ed6-bafc-2f75017bf024 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:11.161402 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-77a751e3-07f7-4ed6-bafc-2f75017bf024 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:11.168972 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-77a751e3-07f7-4ed6-bafc-2f75017bf024 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:11.169425 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-77a751e3-07f7-4ed6-bafc-2f75017bf024 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:11.170234 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-77a751e3-07f7-4ed6-bafc-2f75017bf024 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:11.170676 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-77a751e3-07f7-4ed6-bafc-2f75017bf024 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:11.306230 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-77a751e3-07f7-4ed6-bafc-2f75017bf024 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:11.315255 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-77a751e3-07f7-4ed6-bafc-2f75017bf024 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:11.316771 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-77a751e3-07f7-4ed6-bafc-2f75017bf024 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:11.317974 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-77a751e3-07f7-4ed6-bafc-2f75017bf024 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1731 microversion: 2.20 time: 0.161440 Jun 03 10:05:11.318532 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 474/986] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:05:11 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:05:11.423804 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-50fd633d-2b72-49c3-844e-b3c1294ede88 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:11.424392 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-50fd633d-2b72-49c3-844e-b3c1294ede88 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:11.430916 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-50fd633d-2b72-49c3-844e-b3c1294ede88 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:11.431370 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-50fd633d-2b72-49c3-844e-b3c1294ede88 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:11.432140 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-50fd633d-2b72-49c3-844e-b3c1294ede88 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:11.432580 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-50fd633d-2b72-49c3-844e-b3c1294ede88 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:11.566153 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-50fd633d-2b72-49c3-844e-b3c1294ede88 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:11.573621 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-50fd633d-2b72-49c3-844e-b3c1294ede88 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1564 microversion: 2.1 time: 0.153759 Jun 03 10:05:11.574218 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 513/987] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:11 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1564 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:12.336467 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-81cb7f5d-cb0e-46ce-8466-cdeda7293c68 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:12.337308 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-81cb7f5d-cb0e-46ce-8466-cdeda7293c68 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:12.345060 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-81cb7f5d-cb0e-46ce-8466-cdeda7293c68 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:12.346195 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-81cb7f5d-cb0e-46ce-8466-cdeda7293c68 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:12.347355 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-81cb7f5d-cb0e-46ce-8466-cdeda7293c68 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:12.347767 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-81cb7f5d-cb0e-46ce-8466-cdeda7293c68 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:12.482862 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-81cb7f5d-cb0e-46ce-8466-cdeda7293c68 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:12.490865 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-81cb7f5d-cb0e-46ce-8466-cdeda7293c68 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:12.492363 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-81cb7f5d-cb0e-46ce-8466-cdeda7293c68 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:12.493521 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-81cb7f5d-cb0e-46ce-8466-cdeda7293c68 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1731 microversion: 2.20 time: 0.160984 Jun 03 10:05:12.494091 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 475/988] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:05:12 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:05:13.139664 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-24a01ad9-6512-4921-be92-4ed7f66a81ce tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:13.140162 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-24a01ad9-6512-4921-be92-4ed7f66a81ce tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] [instance: e742fa97-215c-48de-bc9b-d7c3b17c6cb0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:13.146733 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-24a01ad9-6512-4921-be92-4ed7f66a81ce tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:13.147185 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-24a01ad9-6512-4921-be92-4ed7f66a81ce tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:13.147978 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-24a01ad9-6512-4921-be92-4ed7f66a81ce tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:13.148419 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-24a01ad9-6512-4921-be92-4ed7f66a81ce tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:13.233086 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.objects.instance [None req-24a01ad9-6512-4921-be92-4ed7f66a81ce tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lazy-loading 'services' on Instance uuid e742fa97-215c-48de-bc9b-d7c3b17c6cb0 {{(pid=117647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:05:13.311494 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-24a01ad9-6512-4921-be92-4ed7f66a81ce tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] 10.222.0.45 "DELETE /compute/v2.1/servers/e742fa97-215c-48de-bc9b-d7c3b17c6cb0/os-volume_attachments/af786d1d-a451-4ea5-b847-5a36a931bc9a" status: 202 len: 0 microversion: 2.1 time: 0.175593 Jun 03 10:05:13.312102 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 514/989] 10.222.0.45 () {58 vars in 1415 bytes} [Fri Jun 3 10:05:13 2022] DELETE /compute/v2.1/servers/e742fa97-215c-48de-bc9b-d7c3b17c6cb0/os-volume_attachments/af786d1d-a451-4ea5-b847-5a36a931bc9a => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 10:05:13.511583 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-d707417e-c76f-4f64-b61e-5cb089841943 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:13.512198 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-d707417e-c76f-4f64-b61e-5cb089841943 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:13.518344 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d707417e-c76f-4f64-b61e-5cb089841943 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:13.518798 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d707417e-c76f-4f64-b61e-5cb089841943 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:13.519567 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d707417e-c76f-4f64-b61e-5cb089841943 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:13.520017 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d707417e-c76f-4f64-b61e-5cb089841943 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:13.654792 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d707417e-c76f-4f64-b61e-5cb089841943 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:13.664131 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d707417e-c76f-4f64-b61e-5cb089841943 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:13.665651 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d707417e-c76f-4f64-b61e-5cb089841943 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:13.666820 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-d707417e-c76f-4f64-b61e-5cb089841943 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1718 microversion: 2.20 time: 0.159303 Jun 03 10:05:13.667366 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 476/990] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:05:13 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1718 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 03 10:05:14.024172 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-6a1fc631-6535-470e-a713-03948d30862a tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:14.024753 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-6a1fc631-6535-470e-a713-03948d30862a tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: c0b58286-60ef-44eb-8e6b-e8050e695532] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:14.030989 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6a1fc631-6535-470e-a713-03948d30862a tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:14.031440 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6a1fc631-6535-470e-a713-03948d30862a tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:14.032197 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6a1fc631-6535-470e-a713-03948d30862a tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:14.032634 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6a1fc631-6535-470e-a713-03948d30862a tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:14.113685 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.objects.instance [None req-6a1fc631-6535-470e-a713-03948d30862a tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lazy-loading 'services' on Instance uuid c0b58286-60ef-44eb-8e6b-e8050e695532 {{(pid=117647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:05:14.183884 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-6a1fc631-6535-470e-a713-03948d30862a tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532/os-volume_attachments/c035c358-1fd9-4a71-942e-a73249591ede" status: 202 len: 0 microversion: 2.1 time: 0.163757 Jun 03 10:05:14.187312 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 515/991] 10.222.0.45 () {58 vars in 1415 bytes} [Fri Jun 3 10:05:14 2022] DELETE /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532/os-volume_attachments/c035c358-1fd9-4a71-942e-a73249591ede => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 10:05:14.193131 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-d887c490-bb31-4b73-81dd-613145f0ddb6 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:14.194164 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-d887c490-bb31-4b73-81dd-613145f0ddb6 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: c0b58286-60ef-44eb-8e6b-e8050e695532] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:14.196008 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_api:SELECT=56 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:05:14.201421 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d887c490-bb31-4b73-81dd-613145f0ddb6 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:14.201892 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d887c490-bb31-4b73-81dd-613145f0ddb6 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:14.202647 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d887c490-bb31-4b73-81dd-613145f0ddb6 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:14.203158 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d887c490-bb31-4b73-81dd-613145f0ddb6 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:14.232094 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-d887c490-bb31-4b73-81dd-613145f0ddb6 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043345 Jun 03 10:05:14.232632 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 477/992] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 3 10:05:14 2022] GET /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:05:15.244263 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-96d15ffe-991f-4a71-a4ed-c15e534324ae tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:15.245371 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-96d15ffe-991f-4a71-a4ed-c15e534324ae tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: c0b58286-60ef-44eb-8e6b-e8050e695532] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:15.252228 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-96d15ffe-991f-4a71-a4ed-c15e534324ae tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:15.252705 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-96d15ffe-991f-4a71-a4ed-c15e534324ae tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:15.253464 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-96d15ffe-991f-4a71-a4ed-c15e534324ae tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:15.253955 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-96d15ffe-991f-4a71-a4ed-c15e534324ae tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:15.286606 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-96d15ffe-991f-4a71-a4ed-c15e534324ae tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046637 Jun 03 10:05:15.287418 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 516/993] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 3 10:05:15 2022] GET /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:05:15.483616 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-3cff5ff5-5ea7-4e4b-9108-f8f995a4b76b tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:15.484205 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-3cff5ff5-5ea7-4e4b-9108-f8f995a4b76b tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] [instance: e742fa97-215c-48de-bc9b-d7c3b17c6cb0] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:15.490994 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3cff5ff5-5ea7-4e4b-9108-f8f995a4b76b tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:15.491587 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3cff5ff5-5ea7-4e4b-9108-f8f995a4b76b tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:15.492359 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3cff5ff5-5ea7-4e4b-9108-f8f995a4b76b tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:15.492793 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3cff5ff5-5ea7-4e4b-9108-f8f995a4b76b tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:15.518047 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-3cff5ff5-5ea7-4e4b-9108-f8f995a4b76b tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] [instance: e742fa97-215c-48de-bc9b-d7c3b17c6cb0] Going to try to terminate instance {{(pid=117648) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 10:05:15.595414 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-3cff5ff5-5ea7-4e4b-9108-f8f995a4b76b tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] 10.222.0.45 "DELETE /compute/v2.1/servers/e742fa97-215c-48de-bc9b-d7c3b17c6cb0" status: 204 len: 0 microversion: 2.1 time: 0.115145 Jun 03 10:05:15.596499 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 478/994] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jun 3 10:05:15 2022] DELETE /compute/v2.1/servers/e742fa97-215c-48de-bc9b-d7c3b17c6cb0 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 10:05:15.604518 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-969a6772-52f4-4e94-89b1-95adaeb84c75 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:15.605134 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-969a6772-52f4-4e94-89b1-95adaeb84c75 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] [instance: e742fa97-215c-48de-bc9b-d7c3b17c6cb0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:15.611233 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-969a6772-52f4-4e94-89b1-95adaeb84c75 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:15.611688 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-969a6772-52f4-4e94-89b1-95adaeb84c75 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:15.612454 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-969a6772-52f4-4e94-89b1-95adaeb84c75 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:15.612895 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-969a6772-52f4-4e94-89b1-95adaeb84c75 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:15.743821 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-969a6772-52f4-4e94-89b1-95adaeb84c75 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d75851094d145f4907c7049d78dafed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddc37afc4d54ccab945af619507a613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:15.751459 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-969a6772-52f4-4e94-89b1-95adaeb84c75 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] 10.222.0.45 "GET /compute/v2.1/servers/e742fa97-215c-48de-bc9b-d7c3b17c6cb0" status: 200 len: 1512 microversion: 2.1 time: 0.150784 Jun 03 10:05:15.752516 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 517/995] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:15 2022] GET /compute/v2.1/servers/e742fa97-215c-48de-bc9b-d7c3b17c6cb0 => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:05:16.299505 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-42e43d1c-28a2-443e-b800-4b171489e471 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:16.300523 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-42e43d1c-28a2-443e-b800-4b171489e471 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: c0b58286-60ef-44eb-8e6b-e8050e695532] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:16.306625 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-42e43d1c-28a2-443e-b800-4b171489e471 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:16.307116 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-42e43d1c-28a2-443e-b800-4b171489e471 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:16.307893 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-42e43d1c-28a2-443e-b800-4b171489e471 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:16.308336 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-42e43d1c-28a2-443e-b800-4b171489e471 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:16.337356 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-42e43d1c-28a2-443e-b800-4b171489e471 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042743 Jun 03 10:05:16.337916 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 479/996] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 3 10:05:16 2022] GET /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:05:16.768598 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-d335822b-bb4c-4ffd-9b2e-d7ef018fb0e8 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:16.769217 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-d335822b-bb4c-4ffd-9b2e-d7ef018fb0e8 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] [instance: e742fa97-215c-48de-bc9b-d7c3b17c6cb0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:16.771699 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_api:SELECT=58 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:05:16.777035 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d335822b-bb4c-4ffd-9b2e-d7ef018fb0e8 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:16.777494 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d335822b-bb4c-4ffd-9b2e-d7ef018fb0e8 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:16.778288 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d335822b-bb4c-4ffd-9b2e-d7ef018fb0e8 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:16.778726 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d335822b-bb4c-4ffd-9b2e-d7ef018fb0e8 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:16.906078 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-d335822b-bb4c-4ffd-9b2e-d7ef018fb0e8 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d75851094d145f4907c7049d78dafed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddc37afc4d54ccab945af619507a613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:16.913822 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-d335822b-bb4c-4ffd-9b2e-d7ef018fb0e8 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] 10.222.0.45 "GET /compute/v2.1/servers/e742fa97-215c-48de-bc9b-d7c3b17c6cb0" status: 200 len: 1512 microversion: 2.1 time: 0.149097 Jun 03 10:05:16.914383 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 518/997] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:16 2022] GET /compute/v2.1/servers/e742fa97-215c-48de-bc9b-d7c3b17c6cb0 => generated 1512 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:17.350524 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-21c66be3-e59b-4199-aa57-9a4639a57771 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:17.351582 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-21c66be3-e59b-4199-aa57-9a4639a57771 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: c0b58286-60ef-44eb-8e6b-e8050e695532] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:17.358849 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-21c66be3-e59b-4199-aa57-9a4639a57771 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:17.359300 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-21c66be3-e59b-4199-aa57-9a4639a57771 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:17.360069 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-21c66be3-e59b-4199-aa57-9a4639a57771 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:17.360507 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-21c66be3-e59b-4199-aa57-9a4639a57771 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:17.401454 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-21c66be3-e59b-4199-aa57-9a4639a57771 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056822 Jun 03 10:05:17.402058 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 480/998] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 3 10:05:17 2022] GET /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:05:17.931971 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-aac68795-8baa-4614-a1b5-ac128bf92596 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:17.932628 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-aac68795-8baa-4614-a1b5-ac128bf92596 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] [instance: e742fa97-215c-48de-bc9b-d7c3b17c6cb0] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:17.939757 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-aac68795-8baa-4614-a1b5-ac128bf92596 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:17.940208 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-aac68795-8baa-4614-a1b5-ac128bf92596 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:17.940978 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-aac68795-8baa-4614-a1b5-ac128bf92596 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:17.941415 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-aac68795-8baa-4614-a1b5-ac128bf92596 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:18.072323 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-aac68795-8baa-4614-a1b5-ac128bf92596 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d75851094d145f4907c7049d78dafed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddc37afc4d54ccab945af619507a613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:18.080493 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-aac68795-8baa-4614-a1b5-ac128bf92596 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] 10.222.0.45 "GET /compute/v2.1/servers/e742fa97-215c-48de-bc9b-d7c3b17c6cb0" status: 200 len: 1512 microversion: 2.1 time: 0.152982 Jun 03 10:05:18.081079 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 519/999] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:17 2022] GET /compute/v2.1/servers/e742fa97-215c-48de-bc9b-d7c3b17c6cb0 => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:18.339938 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-e4e9ce2c-14c5-45a9-94f5-cb11304cd55e req-fcc9d3c8-2a13-4237-a7d2-71de44ebf7dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e742fa97-215c-48de-bc9b-d7c3b17c6cb0", "name": "network-vif-deleted", "tag": "c2b91a1c-f9d4-44f5-a66a-8c0b3cf2602d"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:05:18.348185 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-e4e9ce2c-14c5-45a9-94f5-cb11304cd55e req-fcc9d3c8-2a13-4237-a7d2-71de44ebf7dc service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:18.348628 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-e4e9ce2c-14c5-45a9-94f5-cb11304cd55e req-fcc9d3c8-2a13-4237-a7d2-71de44ebf7dc service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:18.360141 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-e4e9ce2c-14c5-45a9-94f5-cb11304cd55e req-fcc9d3c8-2a13-4237-a7d2-71de44ebf7dc service nova] Creating event network-vif-deleted:c2b91a1c-f9d4-44f5-a66a-8c0b3cf2602d for instance e742fa97-215c-48de-bc9b-d7c3b17c6cb0 on hv-cinder-79760 Jun 03 10:05:18.365709 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-e4e9ce2c-14c5-45a9-94f5-cb11304cd55e req-fcc9d3c8-2a13-4237-a7d2-71de44ebf7dc service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029429 Jun 03 10:05:18.366327 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 481/1000] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:05:18.413715 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-f72a29f3-a9cd-4a1c-a9a2-f17ccbe91591 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:18.414728 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-f72a29f3-a9cd-4a1c-a9a2-f17ccbe91591 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: c0b58286-60ef-44eb-8e6b-e8050e695532] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:18.420771 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f72a29f3-a9cd-4a1c-a9a2-f17ccbe91591 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:18.421224 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f72a29f3-a9cd-4a1c-a9a2-f17ccbe91591 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:18.422018 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f72a29f3-a9cd-4a1c-a9a2-f17ccbe91591 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:18.422455 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f72a29f3-a9cd-4a1c-a9a2-f17ccbe91591 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:18.451284 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-f72a29f3-a9cd-4a1c-a9a2-f17ccbe91591 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041767 Jun 03 10:05:18.452712 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 520/1001] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 3 10:05:18 2022] GET /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 10:05:18.512161 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-32ffa2a2-58e9-4704-abab-4f90e6835683 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:18.512749 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-32ffa2a2-58e9-4704-abab-4f90e6835683 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: c0b58286-60ef-44eb-8e6b-e8050e695532] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:18.519510 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-32ffa2a2-58e9-4704-abab-4f90e6835683 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:18.519964 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-32ffa2a2-58e9-4704-abab-4f90e6835683 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:18.520734 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-32ffa2a2-58e9-4704-abab-4f90e6835683 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:18.521181 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-32ffa2a2-58e9-4704-abab-4f90e6835683 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:18.546108 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-32ffa2a2-58e9-4704-abab-4f90e6835683 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: c0b58286-60ef-44eb-8e6b-e8050e695532] Going to try to terminate instance {{(pid=117648) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 10:05:18.619252 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-32ffa2a2-58e9-4704-abab-4f90e6835683 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532" status: 204 len: 0 microversion: 2.1 time: 0.112127 Jun 03 10:05:18.619822 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 482/1002] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jun 3 10:05:18 2022] DELETE /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 10:05:18.628464 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-61c495eb-176f-476f-b214-b18904bfd370 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:18.629195 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-61c495eb-176f-476f-b214-b18904bfd370 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: c0b58286-60ef-44eb-8e6b-e8050e695532] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:18.635214 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-61c495eb-176f-476f-b214-b18904bfd370 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:18.635666 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-61c495eb-176f-476f-b214-b18904bfd370 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:18.636432 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-61c495eb-176f-476f-b214-b18904bfd370 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:18.636878 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-61c495eb-176f-476f-b214-b18904bfd370 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:18.766377 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-61c495eb-176f-476f-b214-b18904bfd370 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:18.774700 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-61c495eb-176f-476f-b214-b18904bfd370 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532" status: 200 len: 1683 microversion: 2.1 time: 0.150612 Jun 03 10:05:18.775300 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 521/1003] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:18 2022] GET /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:19.098141 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-153f4de8-bb06-41b3-8560-dcadc3a324b9 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:19.098770 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-153f4de8-bb06-41b3-8560-dcadc3a324b9 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] [instance: e742fa97-215c-48de-bc9b-d7c3b17c6cb0] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:19.104866 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-153f4de8-bb06-41b3-8560-dcadc3a324b9 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:19.105321 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-153f4de8-bb06-41b3-8560-dcadc3a324b9 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:19.106145 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-153f4de8-bb06-41b3-8560-dcadc3a324b9 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:19.106586 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-153f4de8-bb06-41b3-8560-dcadc3a324b9 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:19.138112 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-153f4de8-bb06-41b3-8560-dcadc3a324b9 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:19.138557 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-153f4de8-bb06-41b3-8560-dcadc3a324b9 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:19.139030 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.objects.instance [None req-153f4de8-bb06-41b3-8560-dcadc3a324b9 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lazy-loading 'fault' on Instance uuid e742fa97-215c-48de-bc9b-d7c3b17c6cb0 {{(pid=117648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:05:19.180067 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-153f4de8-bb06-41b3-8560-dcadc3a324b9 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d75851094d145f4907c7049d78dafed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddc37afc4d54ccab945af619507a613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:19.187632 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-153f4de8-bb06-41b3-8560-dcadc3a324b9 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] 10.222.0.45 "GET /compute/v2.1/servers/e742fa97-215c-48de-bc9b-d7c3b17c6cb0" status: 200 len: 1309 microversion: 2.1 time: 0.093879 Jun 03 10:05:19.188192 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 483/1004] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:19 2022] GET /compute/v2.1/servers/e742fa97-215c-48de-bc9b-d7c3b17c6cb0 => generated 1309 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:19.791961 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-60ff600c-03a3-460e-b7b8-bde1140a83c6 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:19.792575 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-60ff600c-03a3-460e-b7b8-bde1140a83c6 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: c0b58286-60ef-44eb-8e6b-e8050e695532] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:19.799078 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-60ff600c-03a3-460e-b7b8-bde1140a83c6 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:19.799573 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-60ff600c-03a3-460e-b7b8-bde1140a83c6 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:19.800337 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-60ff600c-03a3-460e-b7b8-bde1140a83c6 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:19.800774 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-60ff600c-03a3-460e-b7b8-bde1140a83c6 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:19.928667 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-60ff600c-03a3-460e-b7b8-bde1140a83c6 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:19.936103 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-60ff600c-03a3-460e-b7b8-bde1140a83c6 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532" status: 200 len: 1683 microversion: 2.1 time: 0.148015 Jun 03 10:05:19.936666 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 522/1005] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:19 2022] GET /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532 => generated 1683 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:20.205298 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-e8741a90-85bd-44fc-86d6-fe19ab00b69f tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:20.206545 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-e8741a90-85bd-44fc-86d6-fe19ab00b69f tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] [instance: e742fa97-215c-48de-bc9b-d7c3b17c6cb0] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:20.213101 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e8741a90-85bd-44fc-86d6-fe19ab00b69f tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:20.213556 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e8741a90-85bd-44fc-86d6-fe19ab00b69f tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:20.214361 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e8741a90-85bd-44fc-86d6-fe19ab00b69f tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:20.214803 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e8741a90-85bd-44fc-86d6-fe19ab00b69f tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:20.245434 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e8741a90-85bd-44fc-86d6-fe19ab00b69f tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:20.245929 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e8741a90-85bd-44fc-86d6-fe19ab00b69f tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:20.246384 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.objects.instance [None req-e8741a90-85bd-44fc-86d6-fe19ab00b69f tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lazy-loading 'fault' on Instance uuid e742fa97-215c-48de-bc9b-d7c3b17c6cb0 {{(pid=117648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:05:20.286790 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-e8741a90-85bd-44fc-86d6-fe19ab00b69f tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d75851094d145f4907c7049d78dafed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddc37afc4d54ccab945af619507a613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:20.294516 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-e8741a90-85bd-44fc-86d6-fe19ab00b69f tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] 10.222.0.45 "GET /compute/v2.1/servers/e742fa97-215c-48de-bc9b-d7c3b17c6cb0" status: 200 len: 1309 microversion: 2.1 time: 0.093071 Jun 03 10:05:20.295086 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 484/1006] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:20 2022] GET /compute/v2.1/servers/e742fa97-215c-48de-bc9b-d7c3b17c6cb0 => generated 1309 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:20.952540 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-7c9026e5-fc1f-4f5d-99ef-40ec711bd3d3 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:20.953282 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-7c9026e5-fc1f-4f5d-99ef-40ec711bd3d3 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: c0b58286-60ef-44eb-8e6b-e8050e695532] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:20.960410 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7c9026e5-fc1f-4f5d-99ef-40ec711bd3d3 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:20.960863 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7c9026e5-fc1f-4f5d-99ef-40ec711bd3d3 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:20.961650 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7c9026e5-fc1f-4f5d-99ef-40ec711bd3d3 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:20.962118 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7c9026e5-fc1f-4f5d-99ef-40ec711bd3d3 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:21.089910 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-7c9026e5-fc1f-4f5d-99ef-40ec711bd3d3 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:21.097604 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-7c9026e5-fc1f-4f5d-99ef-40ec711bd3d3 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532" status: 200 len: 1683 microversion: 2.1 time: 0.148860 Jun 03 10:05:21.098136 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 523/1007] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:20 2022] GET /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532 => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:21.311332 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-b955cf51-1594-4a1c-b6a0-aeafaa42a30b tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:21.311946 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-b955cf51-1594-4a1c-b6a0-aeafaa42a30b tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] [instance: e742fa97-215c-48de-bc9b-d7c3b17c6cb0] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:21.319106 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b955cf51-1594-4a1c-b6a0-aeafaa42a30b tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:21.319547 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b955cf51-1594-4a1c-b6a0-aeafaa42a30b tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:21.320308 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b955cf51-1594-4a1c-b6a0-aeafaa42a30b tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:21.320740 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b955cf51-1594-4a1c-b6a0-aeafaa42a30b tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:21.334061 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.wsgi [None req-b955cf51-1594-4a1c-b6a0-aeafaa42a30b tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] HTTP exception thrown: Instance e742fa97-215c-48de-bc9b-d7c3b17c6cb0 could not be found. Jun 03 10:05:21.335705 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-b955cf51-1594-4a1c-b6a0-aeafaa42a30b tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Request method failure captured: Jun 03 10:05:21.335705 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: request: GET /compute/v2.1/servers/e742fa97-215c-48de-bc9b-d7c3b17c6cb0 HTTP/1.1 Jun 03 10:05:21.335705 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept: application/json Jun 03 10:05:21.335705 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept-Encoding: identity Jun 03 10:05:21.335705 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Connection: close Jun 03 10:05:21.335705 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Length: 0 Jun 03 10:05:21.335705 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Type: application/json Jun 03 10:05:21.335705 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Host: 10.222.0.45 Jun 03 10:05:21.335705 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Openstack-System-Scope: None Jun 03 10:05:21.335705 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: User-Agent: python-urllib3/1.26.9 Jun 03 10:05:21.335705 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Auth-Token: gAAAAABimdyYT10lYqGF5PLo9GM611qeG6qxzBwmOGYqBLfLKtrln6PR0AwFCDrYQgMpuK744L9r_8ZLlSldKCP-NeBQ8ql7UpKbbSfjA5vCWZCPJMMABo94WTLuUVO-fm0NmHv5YdtJ02GwL1ggrwrtKdZ8qGJsC2JZfdJFWD6QgeW_nnHw9pY Jun 03 10:05:21.335705 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Id: None Jun 03 10:05:21.335705 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Name: None Jun 03 10:05:21.335705 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Identity-Status: Confirmed Jun 03 10:05:21.335705 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Is-Admin-Project: True Jun 03 10:05:21.335705 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Id: default Jun 03 10:05:21.335705 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Name: Default Jun 03 10:05:21.335705 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Id: 0ddc37afc4d54ccab945af619507a613 Jun 03 10:05:21.335705 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2049340705 Jun 03 10:05:21.335705 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Role: member,reader Jun 03 10:05:21.335705 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Roles: member,reader Jun 03 10:05:21.337368 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0ddc37afc4d54ccab945af619507a613", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0ddc37afc4d54ccab945af619507a613"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0ddc37afc4d54ccab945af619507a613"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0ddc37afc4d54ccab945af619507a613"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 10:05:21.337368 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant: tempest-VolumesSnapshotTestJSON-2049340705 Jun 03 10:05:21.337368 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Id: 0ddc37afc4d54ccab945af619507a613 Jun 03 10:05:21.337368 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2049340705 Jun 03 10:05:21.337368 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User: tempest-VolumesSnapshotTestJSON-2049340705-project Jun 03 10:05:21.337368 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Id: default Jun 03 10:05:21.337368 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Name: Default Jun 03 10:05:21.337368 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Id: 1d75851094d145f4907c7049d78dafed Jun 03 10:05:21.337368 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Name: tempest-VolumesSnapshotTestJSON-2049340705-project Jun 03 10:05:21.337368 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: method: > Jun 03 10:05:21.337368 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: exception: Instance e742fa97-215c-48de-bc9b-d7c3b17c6cb0 could not be found. Jun 03 10:05:21.337368 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: action_args: {'id': 'e742fa97-215c-48de-bc9b-d7c3b17c6cb0'} Jun 03 10:05:21.338206 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:05:21.338206 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:05:21.338206 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:05:21.338206 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:05:21.338206 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:05:21.338206 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:05:21.338206 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:05:21.338206 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:05:21.338206 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:05:21.338206 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:05:21.338206 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e742fa97-215c-48de-bc9b-d7c3b17c6cb0 could not be found. Jun 03 10:05:21.338206 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:05:21.338206 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:05:21.338206 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:05:21.338206 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:05:21.338206 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:05:21.338206 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:05:21.338206 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:05:21.338206 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:05:21.338206 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:05:21.339611 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:05:21.339611 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:05:21.339611 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:05:21.339611 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:05:21.339611 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:05:21.339611 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:05:21.339611 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:05:21.339611 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e742fa97-215c-48de-bc9b-d7c3b17c6cb0 could not be found. Jun 03 10:05:21.339611 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:05:21.339611 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:05:21.339611 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:05:21.339611 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:05:21.339611 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:05:21.339611 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:05:21.339611 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:05:21.339611 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:05:21.339611 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e742fa97-215c-48de-bc9b-d7c3b17c6cb0 could not be found. Jun 03 10:05:21.339611 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:05:21.341433 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-b955cf51-1594-4a1c-b6a0-aeafaa42a30b tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Returning 404 to user: Instance e742fa97-215c-48de-bc9b-d7c3b17c6cb0 could not be found. {{(pid=117648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:05:21.341433 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-b955cf51-1594-4a1c-b6a0-aeafaa42a30b tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] 10.222.0.45 "GET /compute/v2.1/servers/e742fa97-215c-48de-bc9b-d7c3b17c6cb0" status: 404 len: 111 microversion: 2.1 time: 0.029622 Jun 03 10:05:21.341433 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 485/1008] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:21 2022] GET /compute/v2.1/servers/e742fa97-215c-48de-bc9b-d7c3b17c6cb0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 10:05:21.633733 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-5f3b5f2a-e552-49ca-87a9-74d872e6ff16 req-00a337f2-f1af-4693-90a6-0d3f76ae9377 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0b58286-60ef-44eb-8e6b-e8050e695532", "name": "network-vif-deleted", "tag": "14baca63-8bc5-42ac-89bd-e8b6cb1ef01c"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:05:21.645204 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-5f3b5f2a-e552-49ca-87a9-74d872e6ff16 req-00a337f2-f1af-4693-90a6-0d3f76ae9377 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:21.646531 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-5f3b5f2a-e552-49ca-87a9-74d872e6ff16 req-00a337f2-f1af-4693-90a6-0d3f76ae9377 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:21.670657 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-5f3b5f2a-e552-49ca-87a9-74d872e6ff16 req-00a337f2-f1af-4693-90a6-0d3f76ae9377 service nova] Creating event network-vif-deleted:14baca63-8bc5-42ac-89bd-e8b6cb1ef01c for instance c0b58286-60ef-44eb-8e6b-e8050e695532 on hv-cinder-79760 Jun 03 10:05:21.676536 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-5f3b5f2a-e552-49ca-87a9-74d872e6ff16 req-00a337f2-f1af-4693-90a6-0d3f76ae9377 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050977 Jun 03 10:05:21.677372 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 524/1009] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:05:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:05:22.113715 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-b63289d3-d690-4679-8f2d-79514d426d90 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:22.114551 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-b63289d3-d690-4679-8f2d-79514d426d90 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: c0b58286-60ef-44eb-8e6b-e8050e695532] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:22.120573 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b63289d3-d690-4679-8f2d-79514d426d90 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:22.121018 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b63289d3-d690-4679-8f2d-79514d426d90 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:22.121800 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b63289d3-d690-4679-8f2d-79514d426d90 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:22.122321 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b63289d3-d690-4679-8f2d-79514d426d90 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:22.153357 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b63289d3-d690-4679-8f2d-79514d426d90 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:22.153831 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b63289d3-d690-4679-8f2d-79514d426d90 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:22.154279 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.objects.instance [None req-b63289d3-d690-4679-8f2d-79514d426d90 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lazy-loading 'fault' on Instance uuid c0b58286-60ef-44eb-8e6b-e8050e695532 {{(pid=117648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:05:22.197314 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-b63289d3-d690-4679-8f2d-79514d426d90 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:22.205241 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-b63289d3-d690-4679-8f2d-79514d426d90 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532" status: 200 len: 1331 microversion: 2.1 time: 0.095440 Jun 03 10:05:22.206349 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 486/1010] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:22 2022] GET /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532 => generated 1331 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:23.224249 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-808d9631-27ea-4e7c-b87a-7d70fb46da4c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:23.224985 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-808d9631-27ea-4e7c-b87a-7d70fb46da4c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: c0b58286-60ef-44eb-8e6b-e8050e695532] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:23.231219 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-808d9631-27ea-4e7c-b87a-7d70fb46da4c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:23.231670 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-808d9631-27ea-4e7c-b87a-7d70fb46da4c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:23.232431 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-808d9631-27ea-4e7c-b87a-7d70fb46da4c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:23.232866 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-808d9631-27ea-4e7c-b87a-7d70fb46da4c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:23.262819 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-808d9631-27ea-4e7c-b87a-7d70fb46da4c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:23.263264 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-808d9631-27ea-4e7c-b87a-7d70fb46da4c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:23.263710 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.objects.instance [None req-808d9631-27ea-4e7c-b87a-7d70fb46da4c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lazy-loading 'fault' on Instance uuid c0b58286-60ef-44eb-8e6b-e8050e695532 {{(pid=117647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:05:23.304771 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-808d9631-27ea-4e7c-b87a-7d70fb46da4c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:23.312215 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-808d9631-27ea-4e7c-b87a-7d70fb46da4c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532" status: 200 len: 1331 microversion: 2.1 time: 0.093293 Jun 03 10:05:23.312783 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 525/1011] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:23 2022] GET /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532 => generated 1331 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:24.328017 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-7648d555-db0e-49fe-a75c-65a387a03ef5 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:24.328587 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-7648d555-db0e-49fe-a75c-65a387a03ef5 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: c0b58286-60ef-44eb-8e6b-e8050e695532] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:24.335188 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7648d555-db0e-49fe-a75c-65a387a03ef5 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:24.335638 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7648d555-db0e-49fe-a75c-65a387a03ef5 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:24.336433 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7648d555-db0e-49fe-a75c-65a387a03ef5 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:24.336873 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7648d555-db0e-49fe-a75c-65a387a03ef5 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:24.353590 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:05:24.371625 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7648d555-db0e-49fe-a75c-65a387a03ef5 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:24.372080 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7648d555-db0e-49fe-a75c-65a387a03ef5 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:24.372529 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.objects.instance [None req-7648d555-db0e-49fe-a75c-65a387a03ef5 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lazy-loading 'fault' on Instance uuid c0b58286-60ef-44eb-8e6b-e8050e695532 {{(pid=117648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:05:24.413320 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-7648d555-db0e-49fe-a75c-65a387a03ef5 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e62d9d781281497e9927c0eb0e85dd75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d4ca628b894615bc311c3705c4a801', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:24.420775 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-7648d555-db0e-49fe-a75c-65a387a03ef5 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532" status: 200 len: 1331 microversion: 2.1 time: 0.096704 Jun 03 10:05:24.421338 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 487/1012] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:24 2022] GET /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532 => generated 1331 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:25.438103 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-e0d3a090-82e0-4269-a63c-0abf7661a1a4 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:25.438718 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-e0d3a090-82e0-4269-a63c-0abf7661a1a4 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: c0b58286-60ef-44eb-8e6b-e8050e695532] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:25.445989 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e0d3a090-82e0-4269-a63c-0abf7661a1a4 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:25.446441 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e0d3a090-82e0-4269-a63c-0abf7661a1a4 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:25.447244 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e0d3a090-82e0-4269-a63c-0abf7661a1a4 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:25.447678 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e0d3a090-82e0-4269-a63c-0abf7661a1a4 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:25.461399 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.wsgi [None req-e0d3a090-82e0-4269-a63c-0abf7661a1a4 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] HTTP exception thrown: Instance c0b58286-60ef-44eb-8e6b-e8050e695532 could not be found. Jun 03 10:05:25.463043 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-e0d3a090-82e0-4269-a63c-0abf7661a1a4 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Request method failure captured: Jun 03 10:05:25.463043 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: request: GET /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532 HTTP/1.1 Jun 03 10:05:25.463043 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Accept: application/json Jun 03 10:05:25.463043 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Accept-Encoding: identity Jun 03 10:05:25.463043 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Connection: close Jun 03 10:05:25.463043 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Content-Length: 0 Jun 03 10:05:25.463043 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Content-Type: application/json Jun 03 10:05:25.463043 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Host: 10.222.0.45 Jun 03 10:05:25.463043 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Openstack-System-Scope: None Jun 03 10:05:25.463043 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: User-Agent: python-urllib3/1.26.9 Jun 03 10:05:25.463043 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Auth-Token: gAAAAABimdrmmGMJYoFEaixKtEm5TQ4XA5jgCy5iwX6ZjbOH9DxrKeyENuD4peBUKmdWr-PDWrDLYLLxy5lixGd2HlPi4aZlZBg9FmZSE7U7_CN_FIxjIovt53hs7DTTUFYYhZcU3_b0MiLpd7TSlEfGmsHpIrMSk9dkjlfpCuRH8mQ4nPiTBOs Jun 03 10:05:25.463043 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Domain-Id: None Jun 03 10:05:25.463043 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Domain-Name: None Jun 03 10:05:25.463043 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Identity-Status: Confirmed Jun 03 10:05:25.463043 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Is-Admin-Project: True Jun 03 10:05:25.463043 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Domain-Id: default Jun 03 10:05:25.463043 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Domain-Name: Default Jun 03 10:05:25.463043 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Id: 12d4ca628b894615bc311c3705c4a801 Jun 03 10:05:25.463043 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Name: tempest-AttachVolumeNegativeTest-1776358070 Jun 03 10:05:25.463043 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Role: member,reader Jun 03 10:05:25.463043 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Roles: member,reader Jun 03 10:05:25.464669 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_12d4ca628b894615bc311c3705c4a801", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/12d4ca628b894615bc311c3705c4a801"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/12d4ca628b894615bc311c3705c4a801"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/12d4ca628b894615bc311c3705c4a801"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 10:05:25.464669 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant: tempest-AttachVolumeNegativeTest-1776358070 Jun 03 10:05:25.464669 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant-Id: 12d4ca628b894615bc311c3705c4a801 Jun 03 10:05:25.464669 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1776358070 Jun 03 10:05:25.464669 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User: tempest-AttachVolumeNegativeTest-1776358070-project Jun 03 10:05:25.464669 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Domain-Id: default Jun 03 10:05:25.464669 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Domain-Name: Default Jun 03 10:05:25.464669 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Id: e62d9d781281497e9927c0eb0e85dd75 Jun 03 10:05:25.464669 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Name: tempest-AttachVolumeNegativeTest-1776358070-project Jun 03 10:05:25.464669 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: method: > Jun 03 10:05:25.464669 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: exception: Instance c0b58286-60ef-44eb-8e6b-e8050e695532 could not be found. Jun 03 10:05:25.464669 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: action_args: {'id': 'c0b58286-60ef-44eb-8e6b-e8050e695532'} Jun 03 10:05:25.465523 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:05:25.465523 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:05:25.465523 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:05:25.465523 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:05:25.465523 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:05:25.465523 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:05:25.465523 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:05:25.465523 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:05:25.465523 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:05:25.465523 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:05:25.465523 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0b58286-60ef-44eb-8e6b-e8050e695532 could not be found. Jun 03 10:05:25.465523 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:05:25.465523 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:05:25.465523 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:05:25.465523 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:05:25.465523 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:05:25.465523 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:05:25.465523 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:05:25.465523 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:05:25.465523 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:05:25.467080 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:05:25.467080 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:05:25.467080 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:05:25.467080 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:05:25.467080 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:05:25.467080 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:05:25.467080 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:05:25.467080 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0b58286-60ef-44eb-8e6b-e8050e695532 could not be found. Jun 03 10:05:25.467080 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:05:25.467080 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:05:25.467080 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:05:25.467080 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:05:25.467080 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:05:25.467080 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:05:25.467080 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:05:25.467080 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:05:25.467080 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0b58286-60ef-44eb-8e6b-e8050e695532 could not be found. Jun 03 10:05:25.467080 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:05:25.468540 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-e0d3a090-82e0-4269-a63c-0abf7661a1a4 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Returning 404 to user: Instance c0b58286-60ef-44eb-8e6b-e8050e695532 could not be found. {{(pid=117647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:05:25.468540 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-e0d3a090-82e0-4269-a63c-0abf7661a1a4 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532" status: 404 len: 111 microversion: 2.1 time: 0.030212 Jun 03 10:05:25.468540 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 526/1013] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:25 2022] GET /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 10:05:25.473229 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-35219f2c-99a3-476a-b87a-aab1eea0e133 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '.version_select at 0x7f5036ddfe50>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:25.491176 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-35219f2c-99a3-476a-b87a-aab1eea0e133 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-881499170" status: 202 len: 0 microversion: 2.1 time: 0.021750 Jun 03 10:05:25.491719 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 488/1014] 10.222.0.45 () {58 vars in 1217 bytes} [Fri Jun 3 10:05:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-881499170 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 10:05:27.245858 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-a7a08aaf-9750-4bc3-96b5-407dae226fa0 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:27.246435 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-a7a08aaf-9750-4bc3-96b5-407dae226fa0 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: c0b58286-60ef-44eb-8e6b-e8050e695532] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:27.252827 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a7a08aaf-9750-4bc3-96b5-407dae226fa0 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:27.253278 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a7a08aaf-9750-4bc3-96b5-407dae226fa0 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:27.254075 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a7a08aaf-9750-4bc3-96b5-407dae226fa0 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:27.254538 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a7a08aaf-9750-4bc3-96b5-407dae226fa0 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:27.268265 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.wsgi [None req-a7a08aaf-9750-4bc3-96b5-407dae226fa0 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] HTTP exception thrown: Instance c0b58286-60ef-44eb-8e6b-e8050e695532 could not be found. Jun 03 10:05:27.269798 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-a7a08aaf-9750-4bc3-96b5-407dae226fa0 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Request method failure captured: Jun 03 10:05:27.269798 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: request: DELETE /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532 HTTP/1.1 Jun 03 10:05:27.269798 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Accept: application/json Jun 03 10:05:27.269798 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Accept-Encoding: identity Jun 03 10:05:27.269798 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Connection: close Jun 03 10:05:27.269798 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Content-Length: 0 Jun 03 10:05:27.269798 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Content-Type: application/json Jun 03 10:05:27.269798 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Host: 10.222.0.45 Jun 03 10:05:27.269798 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Openstack-System-Scope: None Jun 03 10:05:27.269798 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: User-Agent: python-urllib3/1.26.9 Jun 03 10:05:27.269798 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Auth-Token: gAAAAABimdrmmGMJYoFEaixKtEm5TQ4XA5jgCy5iwX6ZjbOH9DxrKeyENuD4peBUKmdWr-PDWrDLYLLxy5lixGd2HlPi4aZlZBg9FmZSE7U7_CN_FIxjIovt53hs7DTTUFYYhZcU3_b0MiLpd7TSlEfGmsHpIrMSk9dkjlfpCuRH8mQ4nPiTBOs Jun 03 10:05:27.269798 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Domain-Id: None Jun 03 10:05:27.269798 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Domain-Name: None Jun 03 10:05:27.269798 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Identity-Status: Confirmed Jun 03 10:05:27.269798 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Is-Admin-Project: True Jun 03 10:05:27.269798 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Domain-Id: default Jun 03 10:05:27.269798 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Domain-Name: Default Jun 03 10:05:27.269798 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Id: 12d4ca628b894615bc311c3705c4a801 Jun 03 10:05:27.269798 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Name: tempest-AttachVolumeNegativeTest-1776358070 Jun 03 10:05:27.269798 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Role: member,reader Jun 03 10:05:27.269798 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Roles: member,reader Jun 03 10:05:27.271333 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_12d4ca628b894615bc311c3705c4a801", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/12d4ca628b894615bc311c3705c4a801"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/12d4ca628b894615bc311c3705c4a801"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/12d4ca628b894615bc311c3705c4a801"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 10:05:27.271333 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant: tempest-AttachVolumeNegativeTest-1776358070 Jun 03 10:05:27.271333 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant-Id: 12d4ca628b894615bc311c3705c4a801 Jun 03 10:05:27.271333 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1776358070 Jun 03 10:05:27.271333 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User: tempest-AttachVolumeNegativeTest-1776358070-project Jun 03 10:05:27.271333 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Domain-Id: default Jun 03 10:05:27.271333 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Domain-Name: Default Jun 03 10:05:27.271333 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Id: e62d9d781281497e9927c0eb0e85dd75 Jun 03 10:05:27.271333 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Name: tempest-AttachVolumeNegativeTest-1776358070-project Jun 03 10:05:27.271333 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: method: > Jun 03 10:05:27.271333 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: exception: Instance c0b58286-60ef-44eb-8e6b-e8050e695532 could not be found. Jun 03 10:05:27.271333 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: action_args: {'id': 'c0b58286-60ef-44eb-8e6b-e8050e695532'} Jun 03 10:05:27.272111 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:05:27.272111 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:05:27.272111 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:05:27.272111 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:05:27.272111 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:05:27.272111 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:05:27.272111 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:05:27.272111 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:05:27.272111 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:05:27.272111 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:05:27.272111 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0b58286-60ef-44eb-8e6b-e8050e695532 could not be found. Jun 03 10:05:27.272111 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:05:27.272111 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:05:27.272111 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:05:27.272111 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:05:27.272111 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:05:27.272111 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:05:27.272111 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:05:27.272111 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:05:27.272111 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:05:27.273633 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:05:27.273633 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 10:05:27.273633 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 10:05:27.273633 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 10:05:27.273633 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 10:05:27.273633 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:05:27.273633 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:05:27.273633 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:05:27.273633 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:05:27.273633 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0b58286-60ef-44eb-8e6b-e8050e695532 could not be found. Jun 03 10:05:27.273633 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:05:27.273633 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:05:27.273633 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:05:27.273633 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:05:27.273633 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:05:27.273633 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:05:27.273633 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:05:27.273633 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:05:27.273633 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0b58286-60ef-44eb-8e6b-e8050e695532 could not be found. Jun 03 10:05:27.273633 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:05:27.275196 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-a7a08aaf-9750-4bc3-96b5-407dae226fa0 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Returning 404 to user: Instance c0b58286-60ef-44eb-8e6b-e8050e695532 could not be found. {{(pid=117647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:05:27.275196 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-a7a08aaf-9750-4bc3-96b5-407dae226fa0 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532" status: 404 len: 111 microversion: 2.1 time: 0.029164 Jun 03 10:05:27.275196 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 527/1015] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jun 3 10:05:27 2022] DELETE /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 10:05:27.280064 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-11d4f612-9d68-4184-a4b9-02b0615bf48c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:27.280684 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-11d4f612-9d68-4184-a4b9-02b0615bf48c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: c0b58286-60ef-44eb-8e6b-e8050e695532] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:27.288620 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-11d4f612-9d68-4184-a4b9-02b0615bf48c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:27.289075 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-11d4f612-9d68-4184-a4b9-02b0615bf48c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:27.289872 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-11d4f612-9d68-4184-a4b9-02b0615bf48c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:27.290311 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-11d4f612-9d68-4184-a4b9-02b0615bf48c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:27.303592 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.wsgi [None req-11d4f612-9d68-4184-a4b9-02b0615bf48c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] HTTP exception thrown: Instance c0b58286-60ef-44eb-8e6b-e8050e695532 could not be found. Jun 03 10:05:27.305088 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-11d4f612-9d68-4184-a4b9-02b0615bf48c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Request method failure captured: Jun 03 10:05:27.305088 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: request: GET /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532 HTTP/1.1 Jun 03 10:05:27.305088 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept: application/json Jun 03 10:05:27.305088 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept-Encoding: identity Jun 03 10:05:27.305088 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Connection: close Jun 03 10:05:27.305088 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Length: 0 Jun 03 10:05:27.305088 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Type: application/json Jun 03 10:05:27.305088 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Host: 10.222.0.45 Jun 03 10:05:27.305088 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Openstack-System-Scope: None Jun 03 10:05:27.305088 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: User-Agent: python-urllib3/1.26.9 Jun 03 10:05:27.305088 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Auth-Token: gAAAAABimdrmmGMJYoFEaixKtEm5TQ4XA5jgCy5iwX6ZjbOH9DxrKeyENuD4peBUKmdWr-PDWrDLYLLxy5lixGd2HlPi4aZlZBg9FmZSE7U7_CN_FIxjIovt53hs7DTTUFYYhZcU3_b0MiLpd7TSlEfGmsHpIrMSk9dkjlfpCuRH8mQ4nPiTBOs Jun 03 10:05:27.305088 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Id: None Jun 03 10:05:27.305088 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Name: None Jun 03 10:05:27.305088 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Identity-Status: Confirmed Jun 03 10:05:27.305088 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Is-Admin-Project: True Jun 03 10:05:27.305088 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Id: default Jun 03 10:05:27.305088 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Name: Default Jun 03 10:05:27.305088 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Id: 12d4ca628b894615bc311c3705c4a801 Jun 03 10:05:27.305088 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Name: tempest-AttachVolumeNegativeTest-1776358070 Jun 03 10:05:27.305088 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Role: member,reader Jun 03 10:05:27.305088 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Roles: member,reader Jun 03 10:05:27.306622 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_12d4ca628b894615bc311c3705c4a801", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/12d4ca628b894615bc311c3705c4a801"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/12d4ca628b894615bc311c3705c4a801"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/12d4ca628b894615bc311c3705c4a801"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 10:05:27.306622 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant: tempest-AttachVolumeNegativeTest-1776358070 Jun 03 10:05:27.306622 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Id: 12d4ca628b894615bc311c3705c4a801 Jun 03 10:05:27.306622 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1776358070 Jun 03 10:05:27.306622 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User: tempest-AttachVolumeNegativeTest-1776358070-project Jun 03 10:05:27.306622 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Id: default Jun 03 10:05:27.306622 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Name: Default Jun 03 10:05:27.306622 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Id: e62d9d781281497e9927c0eb0e85dd75 Jun 03 10:05:27.306622 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Name: tempest-AttachVolumeNegativeTest-1776358070-project Jun 03 10:05:27.306622 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: method: > Jun 03 10:05:27.306622 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: exception: Instance c0b58286-60ef-44eb-8e6b-e8050e695532 could not be found. Jun 03 10:05:27.306622 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: action_args: {'id': 'c0b58286-60ef-44eb-8e6b-e8050e695532'} Jun 03 10:05:27.307439 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:05:27.307439 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:05:27.307439 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:05:27.307439 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:05:27.307439 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:05:27.307439 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:05:27.307439 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:05:27.307439 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:05:27.307439 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:05:27.307439 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:05:27.307439 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0b58286-60ef-44eb-8e6b-e8050e695532 could not be found. Jun 03 10:05:27.307439 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:05:27.307439 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:05:27.307439 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:05:27.307439 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:05:27.307439 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:05:27.307439 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:05:27.307439 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:05:27.307439 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:05:27.307439 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:05:27.308651 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:05:27.308651 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:05:27.308651 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:05:27.308651 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:05:27.308651 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:05:27.308651 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:05:27.308651 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:05:27.308651 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0b58286-60ef-44eb-8e6b-e8050e695532 could not be found. Jun 03 10:05:27.308651 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:05:27.308651 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:05:27.308651 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:05:27.308651 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:05:27.308651 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:05:27.308651 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:05:27.308651 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:05:27.308651 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:05:27.308651 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0b58286-60ef-44eb-8e6b-e8050e695532 could not be found. Jun 03 10:05:27.308651 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:05:27.309738 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-11d4f612-9d68-4184-a4b9-02b0615bf48c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Returning 404 to user: Instance c0b58286-60ef-44eb-8e6b-e8050e695532 could not be found. {{(pid=117648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:05:27.309738 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-11d4f612-9d68-4184-a4b9-02b0615bf48c tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532" status: 404 len: 111 microversion: 2.1 time: 0.030431 Jun 03 10:05:27.309738 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 489/1016] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:27 2022] GET /compute/v2.1/servers/c0b58286-60ef-44eb-8e6b-e8050e695532 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 10:05:30.144760 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-28344c60-1556-4d4e-b49d-01aacf459725 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1478691767", "imageRef": "0cb3b007-4e95-448b-8acb-895d8acdb244", "flavorRef": "452", "networks": [{"uuid": "bfa85722-84cb-4296-8162-976137487800"}]}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:05:30.197532 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.network.neutron [None req-28344c60-1556-4d4e-b49d-01aacf459725 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] validate_networks() for [('bfa85722-84cb-4296-8162-976137487800', None, None, None, None, None)] {{(pid=117647) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 10:05:30.532327 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-28344c60-1556-4d4e-b49d-01aacf459725 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Flavor limits 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 10:05:30.532746 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-28344c60-1556-4d4e-b49d-01aacf459725 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Image limits 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 10:05:30.533237 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-28344c60-1556-4d4e-b49d-01aacf459725 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Flavor pref 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 10:05:30.533643 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-28344c60-1556-4d4e-b49d-01aacf459725 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Image pref 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 10:05:30.534098 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-28344c60-1556-4d4e-b49d-01aacf459725 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 10:05:30.543615 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-28344c60-1556-4d4e-b49d-01aacf459725 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:30.544060 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-28344c60-1556-4d4e-b49d-01aacf459725 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:30.544888 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-28344c60-1556-4d4e-b49d-01aacf459725 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:30.545320 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-28344c60-1556-4d4e-b49d-01aacf459725 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:30.563647 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-28344c60-1556-4d4e-b49d-01aacf459725 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Getting quotas for project 0ddc37afc4d54ccab945af619507a613. Resources: {'ram', 'cores', 'instances'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 10:05:30.567673 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-28344c60-1556-4d4e-b49d-01aacf459725 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Getting quotas for user 1d75851094d145f4907c7049d78dafed and project 0ddc37afc4d54ccab945af619507a613. Resources: {'ram', 'cores', 'instances'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 10:05:30.578493 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-28344c60-1556-4d4e-b49d-01aacf459725 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Going to run 1 instances... {{(pid=117647) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 10:05:30.580726 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-28344c60-1556-4d4e-b49d-01aacf459725 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] [instance: ff92db12-f23f-4be6-a091-217984a75150] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0cb3b007-4e95-448b-8acb-895d8acdb244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 10:05:30.625159 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-28344c60-1556-4d4e-b49d-01aacf459725 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.484260 Jun 03 10:05:30.625719 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 528/1017] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jun 3 10:05:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 485 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 10:05:30.635380 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-e323fe46-fa83-47aa-91f8-29e1b629a21c tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:30.635993 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-e323fe46-fa83-47aa-91f8-29e1b629a21c tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] [instance: ff92db12-f23f-4be6-a091-217984a75150] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:30.691303 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-e323fe46-fa83-47aa-91f8-29e1b629a21c tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d75851094d145f4907c7049d78dafed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddc37afc4d54ccab945af619507a613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:30.698168 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-e323fe46-fa83-47aa-91f8-29e1b629a21c tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] 10.222.0.45 "GET /compute/v2.1/servers/ff92db12-f23f-4be6-a091-217984a75150" status: 200 len: 1219 microversion: 2.1 time: 0.066475 Jun 03 10:05:30.698727 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 490/1018] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:30 2022] GET /compute/v2.1/servers/ff92db12-f23f-4be6-a091-217984a75150 => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:31.715515 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-1f2a1e9f-6375-4735-b832-06af52f6013b tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:31.716135 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-1f2a1e9f-6375-4735-b832-06af52f6013b tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] [instance: ff92db12-f23f-4be6-a091-217984a75150] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:31.722996 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1f2a1e9f-6375-4735-b832-06af52f6013b tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:31.723454 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1f2a1e9f-6375-4735-b832-06af52f6013b tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:31.724253 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1f2a1e9f-6375-4735-b832-06af52f6013b tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:31.724729 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1f2a1e9f-6375-4735-b832-06af52f6013b tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:31.741331 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:05:31.790929 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-1f2a1e9f-6375-4735-b832-06af52f6013b tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d75851094d145f4907c7049d78dafed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddc37afc4d54ccab945af619507a613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:31.798374 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-1f2a1e9f-6375-4735-b832-06af52f6013b tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] 10.222.0.45 "GET /compute/v2.1/servers/ff92db12-f23f-4be6-a091-217984a75150" status: 200 len: 1223 microversion: 2.1 time: 0.087258 Jun 03 10:05:31.799533 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 529/1019] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:31 2022] GET /compute/v2.1/servers/ff92db12-f23f-4be6-a091-217984a75150 => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:32.814922 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-ea173ee6-5525-419f-8ee7-d355964a5c3b tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:32.815536 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-ea173ee6-5525-419f-8ee7-d355964a5c3b tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] [instance: ff92db12-f23f-4be6-a091-217984a75150] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:32.823506 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ea173ee6-5525-419f-8ee7-d355964a5c3b tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:32.823954 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ea173ee6-5525-419f-8ee7-d355964a5c3b tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:32.825338 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ea173ee6-5525-419f-8ee7-d355964a5c3b tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:32.825804 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ea173ee6-5525-419f-8ee7-d355964a5c3b tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:32.884475 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-ea173ee6-5525-419f-8ee7-d355964a5c3b tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d75851094d145f4907c7049d78dafed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddc37afc4d54ccab945af619507a613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:32.891741 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-ea173ee6-5525-419f-8ee7-d355964a5c3b tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] 10.222.0.45 "GET /compute/v2.1/servers/ff92db12-f23f-4be6-a091-217984a75150" status: 200 len: 1223 microversion: 2.1 time: 0.080623 Jun 03 10:05:32.892293 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 491/1020] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:32 2022] GET /compute/v2.1/servers/ff92db12-f23f-4be6-a091-217984a75150 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:33.909125 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-334d7ded-a9a2-4fb2-8365-b0f431f67166 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:33.909717 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-334d7ded-a9a2-4fb2-8365-b0f431f67166 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] [instance: ff92db12-f23f-4be6-a091-217984a75150] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:33.917339 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-334d7ded-a9a2-4fb2-8365-b0f431f67166 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:33.918131 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-334d7ded-a9a2-4fb2-8365-b0f431f67166 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:33.919163 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-334d7ded-a9a2-4fb2-8365-b0f431f67166 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:33.919821 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-334d7ded-a9a2-4fb2-8365-b0f431f67166 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:33.988603 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-334d7ded-a9a2-4fb2-8365-b0f431f67166 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d75851094d145f4907c7049d78dafed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddc37afc4d54ccab945af619507a613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:33.997990 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-334d7ded-a9a2-4fb2-8365-b0f431f67166 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] 10.222.0.45 "GET /compute/v2.1/servers/ff92db12-f23f-4be6-a091-217984a75150" status: 200 len: 1289 microversion: 2.1 time: 0.092855 Jun 03 10:05:33.999114 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 530/1021] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:33 2022] GET /compute/v2.1/servers/ff92db12-f23f-4be6-a091-217984a75150 => generated 1289 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:34.730079 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-2bcc4345-0b9b-4e22-a706-e4ac093dc906 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:34.730584 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-2bcc4345-0b9b-4e22-a706-e4ac093dc906 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: b85ca18b-9b76-43c9-af4d-d7bf77231976] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:34.737266 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2bcc4345-0b9b-4e22-a706-e4ac093dc906 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:34.737822 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2bcc4345-0b9b-4e22-a706-e4ac093dc906 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:34.738675 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2bcc4345-0b9b-4e22-a706-e4ac093dc906 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:34.739687 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2bcc4345-0b9b-4e22-a706-e4ac093dc906 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:34.753580 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.wsgi [None req-2bcc4345-0b9b-4e22-a706-e4ac093dc906 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] HTTP exception thrown: Instance b85ca18b-9b76-43c9-af4d-d7bf77231976 could not be found. Jun 03 10:05:34.755860 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-2bcc4345-0b9b-4e22-a706-e4ac093dc906 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Request method failure captured: Jun 03 10:05:34.755860 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: request: DELETE /compute/v2.1/servers/b85ca18b-9b76-43c9-af4d-d7bf77231976 HTTP/1.1 Jun 03 10:05:34.755860 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept: application/json Jun 03 10:05:34.755860 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept-Encoding: identity Jun 03 10:05:34.755860 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Connection: close Jun 03 10:05:34.755860 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Length: 0 Jun 03 10:05:34.755860 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Type: application/json Jun 03 10:05:34.755860 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Host: 10.222.0.45 Jun 03 10:05:34.755860 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Openstack-System-Scope: None Jun 03 10:05:34.755860 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: User-Agent: python-urllib3/1.26.9 Jun 03 10:05:34.755860 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Auth-Token: gAAAAABimdrmmGMJYoFEaixKtEm5TQ4XA5jgCy5iwX6ZjbOH9DxrKeyENuD4peBUKmdWr-PDWrDLYLLxy5lixGd2HlPi4aZlZBg9FmZSE7U7_CN_FIxjIovt53hs7DTTUFYYhZcU3_b0MiLpd7TSlEfGmsHpIrMSk9dkjlfpCuRH8mQ4nPiTBOs Jun 03 10:05:34.755860 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Id: None Jun 03 10:05:34.755860 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Name: None Jun 03 10:05:34.755860 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Identity-Status: Confirmed Jun 03 10:05:34.755860 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Is-Admin-Project: True Jun 03 10:05:34.755860 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Id: default Jun 03 10:05:34.755860 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Name: Default Jun 03 10:05:34.755860 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Id: 12d4ca628b894615bc311c3705c4a801 Jun 03 10:05:34.755860 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Name: tempest-AttachVolumeNegativeTest-1776358070 Jun 03 10:05:34.755860 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Role: member,reader Jun 03 10:05:34.755860 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Roles: member,reader Jun 03 10:05:34.757295 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_12d4ca628b894615bc311c3705c4a801", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/12d4ca628b894615bc311c3705c4a801"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/12d4ca628b894615bc311c3705c4a801"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/12d4ca628b894615bc311c3705c4a801"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 10:05:34.757295 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant: tempest-AttachVolumeNegativeTest-1776358070 Jun 03 10:05:34.757295 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Id: 12d4ca628b894615bc311c3705c4a801 Jun 03 10:05:34.757295 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1776358070 Jun 03 10:05:34.757295 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User: tempest-AttachVolumeNegativeTest-1776358070-project Jun 03 10:05:34.757295 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Id: default Jun 03 10:05:34.757295 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Name: Default Jun 03 10:05:34.757295 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Id: e62d9d781281497e9927c0eb0e85dd75 Jun 03 10:05:34.757295 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Name: tempest-AttachVolumeNegativeTest-1776358070-project Jun 03 10:05:34.757295 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: method: > Jun 03 10:05:34.757295 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: exception: Instance b85ca18b-9b76-43c9-af4d-d7bf77231976 could not be found. Jun 03 10:05:34.757295 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: action_args: {'id': 'b85ca18b-9b76-43c9-af4d-d7bf77231976'} Jun 03 10:05:34.758113 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:05:34.758113 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:05:34.758113 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:05:34.758113 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:05:34.758113 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:05:34.758113 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:05:34.758113 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:05:34.758113 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:05:34.758113 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:05:34.758113 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:05:34.758113 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b85ca18b-9b76-43c9-af4d-d7bf77231976 could not be found. Jun 03 10:05:34.758113 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:05:34.758113 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:05:34.758113 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:05:34.758113 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:05:34.758113 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:05:34.758113 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:05:34.758113 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:05:34.758113 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:05:34.758113 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:05:34.759372 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:05:34.759372 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 10:05:34.759372 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 10:05:34.759372 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 10:05:34.759372 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 10:05:34.759372 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:05:34.759372 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:05:34.759372 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:05:34.759372 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:05:34.759372 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b85ca18b-9b76-43c9-af4d-d7bf77231976 could not be found. Jun 03 10:05:34.759372 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:05:34.759372 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:05:34.759372 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:05:34.759372 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:05:34.759372 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:05:34.759372 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:05:34.759372 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:05:34.759372 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:05:34.759372 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b85ca18b-9b76-43c9-af4d-d7bf77231976 could not be found. Jun 03 10:05:34.759372 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:05:34.760645 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-2bcc4345-0b9b-4e22-a706-e4ac093dc906 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Returning 404 to user: Instance b85ca18b-9b76-43c9-af4d-d7bf77231976 could not be found. {{(pid=117648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:05:34.760645 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-2bcc4345-0b9b-4e22-a706-e4ac093dc906 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "DELETE /compute/v2.1/servers/b85ca18b-9b76-43c9-af4d-d7bf77231976" status: 404 len: 111 microversion: 2.1 time: 0.031189 Jun 03 10:05:34.760645 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 492/1022] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jun 3 10:05:34 2022] DELETE /compute/v2.1/servers/b85ca18b-9b76-43c9-af4d-d7bf77231976 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 10:05:34.766533 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-ae947b63-d881-469c-9159-33fa7012c5a1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:34.767398 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-ae947b63-d881-469c-9159-33fa7012c5a1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: b85ca18b-9b76-43c9-af4d-d7bf77231976] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:34.773464 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ae947b63-d881-469c-9159-33fa7012c5a1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:34.773963 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ae947b63-d881-469c-9159-33fa7012c5a1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:34.774745 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ae947b63-d881-469c-9159-33fa7012c5a1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:34.775313 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ae947b63-d881-469c-9159-33fa7012c5a1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:34.789411 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.wsgi [None req-ae947b63-d881-469c-9159-33fa7012c5a1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] HTTP exception thrown: Instance b85ca18b-9b76-43c9-af4d-d7bf77231976 could not be found. Jun 03 10:05:34.790984 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-ae947b63-d881-469c-9159-33fa7012c5a1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Request method failure captured: Jun 03 10:05:34.790984 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: request: GET /compute/v2.1/servers/b85ca18b-9b76-43c9-af4d-d7bf77231976 HTTP/1.1 Jun 03 10:05:34.790984 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Accept: application/json Jun 03 10:05:34.790984 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Accept-Encoding: identity Jun 03 10:05:34.790984 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Connection: close Jun 03 10:05:34.790984 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Content-Length: 0 Jun 03 10:05:34.790984 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Content-Type: application/json Jun 03 10:05:34.790984 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Host: 10.222.0.45 Jun 03 10:05:34.790984 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Openstack-System-Scope: None Jun 03 10:05:34.790984 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: User-Agent: python-urllib3/1.26.9 Jun 03 10:05:34.790984 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Auth-Token: gAAAAABimdrmmGMJYoFEaixKtEm5TQ4XA5jgCy5iwX6ZjbOH9DxrKeyENuD4peBUKmdWr-PDWrDLYLLxy5lixGd2HlPi4aZlZBg9FmZSE7U7_CN_FIxjIovt53hs7DTTUFYYhZcU3_b0MiLpd7TSlEfGmsHpIrMSk9dkjlfpCuRH8mQ4nPiTBOs Jun 03 10:05:34.790984 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Domain-Id: None Jun 03 10:05:34.790984 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Domain-Name: None Jun 03 10:05:34.790984 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Identity-Status: Confirmed Jun 03 10:05:34.790984 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Is-Admin-Project: True Jun 03 10:05:34.790984 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Domain-Id: default Jun 03 10:05:34.790984 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Domain-Name: Default Jun 03 10:05:34.790984 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Id: 12d4ca628b894615bc311c3705c4a801 Jun 03 10:05:34.790984 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Name: tempest-AttachVolumeNegativeTest-1776358070 Jun 03 10:05:34.790984 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Role: member,reader Jun 03 10:05:34.790984 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Roles: member,reader Jun 03 10:05:34.792560 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_12d4ca628b894615bc311c3705c4a801", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/12d4ca628b894615bc311c3705c4a801"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/12d4ca628b894615bc311c3705c4a801"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/12d4ca628b894615bc311c3705c4a801"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 10:05:34.792560 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant: tempest-AttachVolumeNegativeTest-1776358070 Jun 03 10:05:34.792560 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant-Id: 12d4ca628b894615bc311c3705c4a801 Jun 03 10:05:34.792560 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1776358070 Jun 03 10:05:34.792560 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User: tempest-AttachVolumeNegativeTest-1776358070-project Jun 03 10:05:34.792560 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Domain-Id: default Jun 03 10:05:34.792560 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Domain-Name: Default Jun 03 10:05:34.792560 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Id: e62d9d781281497e9927c0eb0e85dd75 Jun 03 10:05:34.792560 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Name: tempest-AttachVolumeNegativeTest-1776358070-project Jun 03 10:05:34.792560 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: method: > Jun 03 10:05:34.792560 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: exception: Instance b85ca18b-9b76-43c9-af4d-d7bf77231976 could not be found. Jun 03 10:05:34.792560 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: action_args: {'id': 'b85ca18b-9b76-43c9-af4d-d7bf77231976'} Jun 03 10:05:34.793352 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:05:34.793352 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:05:34.793352 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:05:34.793352 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:05:34.793352 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:05:34.793352 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:05:34.793352 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:05:34.793352 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:05:34.793352 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:05:34.793352 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:05:34.793352 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b85ca18b-9b76-43c9-af4d-d7bf77231976 could not be found. Jun 03 10:05:34.793352 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:05:34.793352 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:05:34.793352 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:05:34.793352 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:05:34.793352 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:05:34.793352 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:05:34.793352 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:05:34.793352 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:05:34.793352 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:05:34.794885 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:05:34.794885 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:05:34.794885 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:05:34.794885 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:05:34.794885 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:05:34.794885 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:05:34.794885 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:05:34.794885 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b85ca18b-9b76-43c9-af4d-d7bf77231976 could not be found. Jun 03 10:05:34.794885 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:05:34.794885 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:05:34.794885 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:05:34.794885 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:05:34.794885 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:05:34.794885 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:05:34.794885 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:05:34.794885 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:05:34.794885 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b85ca18b-9b76-43c9-af4d-d7bf77231976 could not be found. Jun 03 10:05:34.794885 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:05:34.796158 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-ae947b63-d881-469c-9159-33fa7012c5a1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Returning 404 to user: Instance b85ca18b-9b76-43c9-af4d-d7bf77231976 could not be found. {{(pid=117647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:05:34.796158 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-ae947b63-d881-469c-9159-33fa7012c5a1 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/b85ca18b-9b76-43c9-af4d-d7bf77231976" status: 404 len: 111 microversion: 2.1 time: 0.029681 Jun 03 10:05:34.796158 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 531/1023] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:34 2022] GET /compute/v2.1/servers/b85ca18b-9b76-43c9-af4d-d7bf77231976 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 10:05:34.800866 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-09378585-7797-4c01-8d8e-ccde575fd96e tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:34.801358 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-09378585-7797-4c01-8d8e-ccde575fd96e tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 2ecad1bf-3c89-4b29-a511-6e3d71a834fc] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:34.808339 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-09378585-7797-4c01-8d8e-ccde575fd96e tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:34.808795 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-09378585-7797-4c01-8d8e-ccde575fd96e tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:34.809574 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-09378585-7797-4c01-8d8e-ccde575fd96e tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:34.810044 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-09378585-7797-4c01-8d8e-ccde575fd96e tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:34.824184 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.wsgi [None req-09378585-7797-4c01-8d8e-ccde575fd96e tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] HTTP exception thrown: Instance 2ecad1bf-3c89-4b29-a511-6e3d71a834fc could not be found. Jun 03 10:05:34.825777 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-09378585-7797-4c01-8d8e-ccde575fd96e tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Request method failure captured: Jun 03 10:05:34.825777 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: request: DELETE /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc HTTP/1.1 Jun 03 10:05:34.825777 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept: application/json Jun 03 10:05:34.825777 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept-Encoding: identity Jun 03 10:05:34.825777 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Connection: close Jun 03 10:05:34.825777 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Length: 0 Jun 03 10:05:34.825777 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Type: application/json Jun 03 10:05:34.825777 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Host: 10.222.0.45 Jun 03 10:05:34.825777 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Openstack-System-Scope: None Jun 03 10:05:34.825777 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: User-Agent: python-urllib3/1.26.9 Jun 03 10:05:34.825777 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Auth-Token: gAAAAABimdrmmGMJYoFEaixKtEm5TQ4XA5jgCy5iwX6ZjbOH9DxrKeyENuD4peBUKmdWr-PDWrDLYLLxy5lixGd2HlPi4aZlZBg9FmZSE7U7_CN_FIxjIovt53hs7DTTUFYYhZcU3_b0MiLpd7TSlEfGmsHpIrMSk9dkjlfpCuRH8mQ4nPiTBOs Jun 03 10:05:34.825777 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Id: None Jun 03 10:05:34.825777 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Name: None Jun 03 10:05:34.825777 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Identity-Status: Confirmed Jun 03 10:05:34.825777 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Is-Admin-Project: True Jun 03 10:05:34.825777 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Id: default Jun 03 10:05:34.825777 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Name: Default Jun 03 10:05:34.825777 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Id: 12d4ca628b894615bc311c3705c4a801 Jun 03 10:05:34.825777 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Name: tempest-AttachVolumeNegativeTest-1776358070 Jun 03 10:05:34.825777 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Role: member,reader Jun 03 10:05:34.825777 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Roles: member,reader Jun 03 10:05:34.827281 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_12d4ca628b894615bc311c3705c4a801", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/12d4ca628b894615bc311c3705c4a801"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/12d4ca628b894615bc311c3705c4a801"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/12d4ca628b894615bc311c3705c4a801"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 10:05:34.827281 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant: tempest-AttachVolumeNegativeTest-1776358070 Jun 03 10:05:34.827281 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Id: 12d4ca628b894615bc311c3705c4a801 Jun 03 10:05:34.827281 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1776358070 Jun 03 10:05:34.827281 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User: tempest-AttachVolumeNegativeTest-1776358070-project Jun 03 10:05:34.827281 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Id: default Jun 03 10:05:34.827281 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Name: Default Jun 03 10:05:34.827281 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Id: e62d9d781281497e9927c0eb0e85dd75 Jun 03 10:05:34.827281 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Name: tempest-AttachVolumeNegativeTest-1776358070-project Jun 03 10:05:34.827281 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: method: > Jun 03 10:05:34.827281 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: exception: Instance 2ecad1bf-3c89-4b29-a511-6e3d71a834fc could not be found. Jun 03 10:05:34.827281 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: action_args: {'id': '2ecad1bf-3c89-4b29-a511-6e3d71a834fc'} Jun 03 10:05:34.828207 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:05:34.828207 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:05:34.828207 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:05:34.828207 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:05:34.828207 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:05:34.828207 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:05:34.828207 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:05:34.828207 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:05:34.828207 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:05:34.828207 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:05:34.828207 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ecad1bf-3c89-4b29-a511-6e3d71a834fc could not be found. Jun 03 10:05:34.828207 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:05:34.828207 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:05:34.828207 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:05:34.828207 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:05:34.828207 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:05:34.828207 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:05:34.828207 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:05:34.828207 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:05:34.828207 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:05:34.829509 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:05:34.829509 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 10:05:34.829509 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 10:05:34.829509 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 10:05:34.829509 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 10:05:34.829509 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:05:34.829509 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:05:34.829509 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:05:34.829509 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:05:34.829509 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ecad1bf-3c89-4b29-a511-6e3d71a834fc could not be found. Jun 03 10:05:34.829509 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:05:34.829509 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:05:34.829509 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:05:34.829509 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:05:34.829509 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:05:34.829509 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:05:34.829509 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:05:34.829509 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:05:34.829509 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ecad1bf-3c89-4b29-a511-6e3d71a834fc could not be found. Jun 03 10:05:34.829509 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:05:34.830878 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-09378585-7797-4c01-8d8e-ccde575fd96e tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Returning 404 to user: Instance 2ecad1bf-3c89-4b29-a511-6e3d71a834fc could not be found. {{(pid=117648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:05:34.830878 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-09378585-7797-4c01-8d8e-ccde575fd96e tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "DELETE /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc" status: 404 len: 111 microversion: 2.1 time: 0.030254 Jun 03 10:05:34.830878 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 493/1024] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jun 3 10:05:34 2022] DELETE /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 03 10:05:34.835471 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-5f33fd44-c588-49b8-a2ae-35010c200e38 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:34.836088 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-5f33fd44-c588-49b8-a2ae-35010c200e38 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 2ecad1bf-3c89-4b29-a511-6e3d71a834fc] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:34.842740 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5f33fd44-c588-49b8-a2ae-35010c200e38 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:34.843197 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5f33fd44-c588-49b8-a2ae-35010c200e38 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:34.843972 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5f33fd44-c588-49b8-a2ae-35010c200e38 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:34.844412 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5f33fd44-c588-49b8-a2ae-35010c200e38 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:34.858685 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.wsgi [None req-5f33fd44-c588-49b8-a2ae-35010c200e38 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] HTTP exception thrown: Instance 2ecad1bf-3c89-4b29-a511-6e3d71a834fc could not be found. Jun 03 10:05:34.860203 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-5f33fd44-c588-49b8-a2ae-35010c200e38 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Request method failure captured: Jun 03 10:05:34.860203 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: request: GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc HTTP/1.1 Jun 03 10:05:34.860203 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Accept: application/json Jun 03 10:05:34.860203 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Accept-Encoding: identity Jun 03 10:05:34.860203 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Connection: close Jun 03 10:05:34.860203 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Content-Length: 0 Jun 03 10:05:34.860203 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Content-Type: application/json Jun 03 10:05:34.860203 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Host: 10.222.0.45 Jun 03 10:05:34.860203 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Openstack-System-Scope: None Jun 03 10:05:34.860203 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: User-Agent: python-urllib3/1.26.9 Jun 03 10:05:34.860203 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Auth-Token: gAAAAABimdrmmGMJYoFEaixKtEm5TQ4XA5jgCy5iwX6ZjbOH9DxrKeyENuD4peBUKmdWr-PDWrDLYLLxy5lixGd2HlPi4aZlZBg9FmZSE7U7_CN_FIxjIovt53hs7DTTUFYYhZcU3_b0MiLpd7TSlEfGmsHpIrMSk9dkjlfpCuRH8mQ4nPiTBOs Jun 03 10:05:34.860203 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Domain-Id: None Jun 03 10:05:34.860203 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Domain-Name: None Jun 03 10:05:34.860203 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Identity-Status: Confirmed Jun 03 10:05:34.860203 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Is-Admin-Project: True Jun 03 10:05:34.860203 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Domain-Id: default Jun 03 10:05:34.860203 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Domain-Name: Default Jun 03 10:05:34.860203 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Id: 12d4ca628b894615bc311c3705c4a801 Jun 03 10:05:34.860203 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Name: tempest-AttachVolumeNegativeTest-1776358070 Jun 03 10:05:34.860203 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Role: member,reader Jun 03 10:05:34.860203 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Roles: member,reader Jun 03 10:05:34.861718 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_12d4ca628b894615bc311c3705c4a801", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/12d4ca628b894615bc311c3705c4a801"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/12d4ca628b894615bc311c3705c4a801"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/12d4ca628b894615bc311c3705c4a801"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 10:05:34.861718 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant: tempest-AttachVolumeNegativeTest-1776358070 Jun 03 10:05:34.861718 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant-Id: 12d4ca628b894615bc311c3705c4a801 Jun 03 10:05:34.861718 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1776358070 Jun 03 10:05:34.861718 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User: tempest-AttachVolumeNegativeTest-1776358070-project Jun 03 10:05:34.861718 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Domain-Id: default Jun 03 10:05:34.861718 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Domain-Name: Default Jun 03 10:05:34.861718 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Id: e62d9d781281497e9927c0eb0e85dd75 Jun 03 10:05:34.861718 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Name: tempest-AttachVolumeNegativeTest-1776358070-project Jun 03 10:05:34.861718 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: method: > Jun 03 10:05:34.861718 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: exception: Instance 2ecad1bf-3c89-4b29-a511-6e3d71a834fc could not be found. Jun 03 10:05:34.861718 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: action_args: {'id': '2ecad1bf-3c89-4b29-a511-6e3d71a834fc'} Jun 03 10:05:34.862673 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:05:34.862673 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:05:34.862673 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:05:34.862673 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:05:34.862673 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:05:34.862673 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:05:34.862673 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:05:34.862673 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:05:34.862673 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:05:34.862673 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:05:34.862673 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ecad1bf-3c89-4b29-a511-6e3d71a834fc could not be found. Jun 03 10:05:34.862673 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:05:34.862673 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:05:34.862673 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:05:34.862673 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:05:34.862673 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:05:34.862673 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:05:34.862673 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:05:34.862673 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:05:34.862673 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:05:34.864716 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:05:34.864716 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:05:34.864716 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:05:34.864716 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:05:34.864716 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:05:34.864716 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:05:34.864716 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:05:34.864716 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ecad1bf-3c89-4b29-a511-6e3d71a834fc could not be found. Jun 03 10:05:34.864716 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:05:34.864716 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:05:34.864716 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:05:34.864716 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:05:34.864716 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:05:34.864716 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:05:34.864716 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:05:34.864716 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:05:34.864716 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ecad1bf-3c89-4b29-a511-6e3d71a834fc could not be found. Jun 03 10:05:34.864716 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:05:34.866837 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-5f33fd44-c588-49b8-a2ae-35010c200e38 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Returning 404 to user: Instance 2ecad1bf-3c89-4b29-a511-6e3d71a834fc could not be found. {{(pid=117647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:05:34.866837 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-5f33fd44-c588-49b8-a2ae-35010c200e38 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc" status: 404 len: 111 microversion: 2.1 time: 0.029931 Jun 03 10:05:34.866837 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 532/1025] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:34 2022] GET /compute/v2.1/servers/2ecad1bf-3c89-4b29-a511-6e3d71a834fc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 10:05:35.015160 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-e90f9ee6-f7db-4d2c-baa0-90609edf3c74 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:35.015727 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-e90f9ee6-f7db-4d2c-baa0-90609edf3c74 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] [instance: ff92db12-f23f-4be6-a091-217984a75150] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:35.021742 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e90f9ee6-f7db-4d2c-baa0-90609edf3c74 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:35.022224 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e90f9ee6-f7db-4d2c-baa0-90609edf3c74 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:35.023029 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e90f9ee6-f7db-4d2c-baa0-90609edf3c74 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:35.023468 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e90f9ee6-f7db-4d2c-baa0-90609edf3c74 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:35.157441 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-e90f9ee6-f7db-4d2c-baa0-90609edf3c74 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d75851094d145f4907c7049d78dafed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddc37afc4d54ccab945af619507a613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:35.166012 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-e90f9ee6-f7db-4d2c-baa0-90609edf3c74 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] 10.222.0.45 "GET /compute/v2.1/servers/ff92db12-f23f-4be6-a091-217984a75150" status: 200 len: 1319 microversion: 2.1 time: 0.154733 Jun 03 10:05:35.166584 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 494/1026] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:35 2022] GET /compute/v2.1/servers/ff92db12-f23f-4be6-a091-217984a75150 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:35.220467 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-171a1ef1-fc67-4256-b1c2-ce36124d577b req-c0f1838f-a2cf-4926-a9c2-365031b08110 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff92db12-f23f-4be6-a091-217984a75150", "tag": "bbb54229-7afa-4f45-b103-0476a9389d56"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:05:35.229789 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-171a1ef1-fc67-4256-b1c2-ce36124d577b req-c0f1838f-a2cf-4926-a9c2-365031b08110 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:35.230336 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-171a1ef1-fc67-4256-b1c2-ce36124d577b req-c0f1838f-a2cf-4926-a9c2-365031b08110 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:35.242705 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-171a1ef1-fc67-4256-b1c2-ce36124d577b req-c0f1838f-a2cf-4926-a9c2-365031b08110 service nova] Creating event network-changed:bbb54229-7afa-4f45-b103-0476a9389d56 for instance ff92db12-f23f-4be6-a091-217984a75150 on hv-cinder-79760 Jun 03 10:05:35.247583 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-171a1ef1-fc67-4256-b1c2-ce36124d577b req-c0f1838f-a2cf-4926-a9c2-365031b08110 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030820 Jun 03 10:05:35.248263 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 533/1027] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:05:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:05:36.182530 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-aefaa010-1b61-44f0-8e30-3c1110d8ca7b tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:36.183146 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-aefaa010-1b61-44f0-8e30-3c1110d8ca7b tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] [instance: ff92db12-f23f-4be6-a091-217984a75150] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:36.189579 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-aefaa010-1b61-44f0-8e30-3c1110d8ca7b tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:36.190061 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-aefaa010-1b61-44f0-8e30-3c1110d8ca7b tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:36.190829 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-aefaa010-1b61-44f0-8e30-3c1110d8ca7b tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:36.191265 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-aefaa010-1b61-44f0-8e30-3c1110d8ca7b tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:36.322420 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-aefaa010-1b61-44f0-8e30-3c1110d8ca7b tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d75851094d145f4907c7049d78dafed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddc37afc4d54ccab945af619507a613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:36.329821 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-aefaa010-1b61-44f0-8e30-3c1110d8ca7b tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] 10.222.0.45 "GET /compute/v2.1/servers/ff92db12-f23f-4be6-a091-217984a75150" status: 200 len: 1319 microversion: 2.1 time: 0.151080 Jun 03 10:05:36.330378 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 495/1028] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:36 2022] GET /compute/v2.1/servers/ff92db12-f23f-4be6-a091-217984a75150 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:37.054250 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-f45912cb-03b4-40c9-ac25-b0240a317db0 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:37.054839 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-f45912cb-03b4-40c9-ac25-b0240a317db0 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:37.061258 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f45912cb-03b4-40c9-ac25-b0240a317db0 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:37.061699 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f45912cb-03b4-40c9-ac25-b0240a317db0 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:37.062500 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f45912cb-03b4-40c9-ac25-b0240a317db0 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:37.062932 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f45912cb-03b4-40c9-ac25-b0240a317db0 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:37.076398 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.wsgi [None req-f45912cb-03b4-40c9-ac25-b0240a317db0 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] HTTP exception thrown: Instance 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e could not be found. Jun 03 10:05:37.078065 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-f45912cb-03b4-40c9-ac25-b0240a317db0 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Request method failure captured: Jun 03 10:05:37.078065 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: request: DELETE /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e HTTP/1.1 Jun 03 10:05:37.078065 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Accept: application/json Jun 03 10:05:37.078065 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Accept-Encoding: identity Jun 03 10:05:37.078065 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Connection: close Jun 03 10:05:37.078065 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Content-Length: 0 Jun 03 10:05:37.078065 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Content-Type: application/json Jun 03 10:05:37.078065 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Host: 10.222.0.45 Jun 03 10:05:37.078065 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Openstack-System-Scope: None Jun 03 10:05:37.078065 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: User-Agent: python-urllib3/1.26.9 Jun 03 10:05:37.078065 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Auth-Token: gAAAAABimdrmmGMJYoFEaixKtEm5TQ4XA5jgCy5iwX6ZjbOH9DxrKeyENuD4peBUKmdWr-PDWrDLYLLxy5lixGd2HlPi4aZlZBg9FmZSE7U7_CN_FIxjIovt53hs7DTTUFYYhZcU3_b0MiLpd7TSlEfGmsHpIrMSk9dkjlfpCuRH8mQ4nPiTBOs Jun 03 10:05:37.078065 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Domain-Id: None Jun 03 10:05:37.078065 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Domain-Name: None Jun 03 10:05:37.078065 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Identity-Status: Confirmed Jun 03 10:05:37.078065 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Is-Admin-Project: True Jun 03 10:05:37.078065 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Domain-Id: default Jun 03 10:05:37.078065 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Domain-Name: Default Jun 03 10:05:37.078065 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Id: 12d4ca628b894615bc311c3705c4a801 Jun 03 10:05:37.078065 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Name: tempest-AttachVolumeNegativeTest-1776358070 Jun 03 10:05:37.078065 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Role: member,reader Jun 03 10:05:37.078065 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Roles: member,reader Jun 03 10:05:37.079648 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_12d4ca628b894615bc311c3705c4a801", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/12d4ca628b894615bc311c3705c4a801"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/12d4ca628b894615bc311c3705c4a801"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/12d4ca628b894615bc311c3705c4a801"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 10:05:37.079648 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant: tempest-AttachVolumeNegativeTest-1776358070 Jun 03 10:05:37.079648 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant-Id: 12d4ca628b894615bc311c3705c4a801 Jun 03 10:05:37.079648 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1776358070 Jun 03 10:05:37.079648 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User: tempest-AttachVolumeNegativeTest-1776358070-project Jun 03 10:05:37.079648 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Domain-Id: default Jun 03 10:05:37.079648 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Domain-Name: Default Jun 03 10:05:37.079648 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Id: e62d9d781281497e9927c0eb0e85dd75 Jun 03 10:05:37.079648 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Name: tempest-AttachVolumeNegativeTest-1776358070-project Jun 03 10:05:37.079648 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: method: > Jun 03 10:05:37.079648 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: exception: Instance 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e could not be found. Jun 03 10:05:37.079648 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: action_args: {'id': '6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e'} Jun 03 10:05:37.080472 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:05:37.080472 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:05:37.080472 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:05:37.080472 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:05:37.080472 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:05:37.080472 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:05:37.080472 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:05:37.080472 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:05:37.080472 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:05:37.080472 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:05:37.080472 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e could not be found. Jun 03 10:05:37.080472 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:05:37.080472 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:05:37.080472 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:05:37.080472 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:05:37.080472 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:05:37.080472 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:05:37.080472 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:05:37.080472 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:05:37.080472 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:05:37.081701 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:05:37.081701 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 10:05:37.081701 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 10:05:37.081701 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 10:05:37.081701 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 10:05:37.081701 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:05:37.081701 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:05:37.081701 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:05:37.081701 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:05:37.081701 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e could not be found. Jun 03 10:05:37.081701 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:05:37.081701 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:05:37.081701 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:05:37.081701 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:05:37.081701 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:05:37.081701 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:05:37.081701 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:05:37.081701 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:05:37.081701 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e could not be found. Jun 03 10:05:37.081701 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:05:37.083532 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-f45912cb-03b4-40c9-ac25-b0240a317db0 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Returning 404 to user: Instance 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e could not be found. {{(pid=117647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:05:37.083532 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-f45912cb-03b4-40c9-ac25-b0240a317db0 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "DELETE /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e" status: 404 len: 111 microversion: 2.1 time: 0.030204 Jun 03 10:05:37.083532 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 534/1029] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jun 3 10:05:37 2022] DELETE /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 10:05:37.089188 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-c471d394-7f05-4a5e-ab39-5b1ec20a4fc8 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:37.089857 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-c471d394-7f05-4a5e-ab39-5b1ec20a4fc8 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] [instance: 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:37.095906 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c471d394-7f05-4a5e-ab39-5b1ec20a4fc8 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:37.096357 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c471d394-7f05-4a5e-ab39-5b1ec20a4fc8 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:37.097123 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c471d394-7f05-4a5e-ab39-5b1ec20a4fc8 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:37.097617 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c471d394-7f05-4a5e-ab39-5b1ec20a4fc8 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:37.118312 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.wsgi [None req-c471d394-7f05-4a5e-ab39-5b1ec20a4fc8 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] HTTP exception thrown: Instance 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e could not be found. Jun 03 10:05:37.120066 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-c471d394-7f05-4a5e-ab39-5b1ec20a4fc8 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Request method failure captured: Jun 03 10:05:37.120066 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: request: GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e HTTP/1.1 Jun 03 10:05:37.120066 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept: application/json Jun 03 10:05:37.120066 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept-Encoding: identity Jun 03 10:05:37.120066 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Connection: close Jun 03 10:05:37.120066 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Length: 0 Jun 03 10:05:37.120066 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Type: application/json Jun 03 10:05:37.120066 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Host: 10.222.0.45 Jun 03 10:05:37.120066 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Openstack-System-Scope: None Jun 03 10:05:37.120066 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: User-Agent: python-urllib3/1.26.9 Jun 03 10:05:37.120066 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Auth-Token: gAAAAABimdrmmGMJYoFEaixKtEm5TQ4XA5jgCy5iwX6ZjbOH9DxrKeyENuD4peBUKmdWr-PDWrDLYLLxy5lixGd2HlPi4aZlZBg9FmZSE7U7_CN_FIxjIovt53hs7DTTUFYYhZcU3_b0MiLpd7TSlEfGmsHpIrMSk9dkjlfpCuRH8mQ4nPiTBOs Jun 03 10:05:37.120066 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Id: None Jun 03 10:05:37.120066 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Name: None Jun 03 10:05:37.120066 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Identity-Status: Confirmed Jun 03 10:05:37.120066 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Is-Admin-Project: True Jun 03 10:05:37.120066 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Id: default Jun 03 10:05:37.120066 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Name: Default Jun 03 10:05:37.120066 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Id: 12d4ca628b894615bc311c3705c4a801 Jun 03 10:05:37.120066 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Name: tempest-AttachVolumeNegativeTest-1776358070 Jun 03 10:05:37.120066 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Role: member,reader Jun 03 10:05:37.120066 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Roles: member,reader Jun 03 10:05:37.121991 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_12d4ca628b894615bc311c3705c4a801", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/12d4ca628b894615bc311c3705c4a801"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/12d4ca628b894615bc311c3705c4a801"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/12d4ca628b894615bc311c3705c4a801"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 10:05:37.121991 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant: tempest-AttachVolumeNegativeTest-1776358070 Jun 03 10:05:37.121991 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Id: 12d4ca628b894615bc311c3705c4a801 Jun 03 10:05:37.121991 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1776358070 Jun 03 10:05:37.121991 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User: tempest-AttachVolumeNegativeTest-1776358070-project Jun 03 10:05:37.121991 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Id: default Jun 03 10:05:37.121991 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Name: Default Jun 03 10:05:37.121991 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Id: e62d9d781281497e9927c0eb0e85dd75 Jun 03 10:05:37.121991 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Name: tempest-AttachVolumeNegativeTest-1776358070-project Jun 03 10:05:37.121991 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: method: > Jun 03 10:05:37.121991 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: exception: Instance 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e could not be found. Jun 03 10:05:37.121991 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: action_args: {'id': '6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e'} Jun 03 10:05:37.123055 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:05:37.123055 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:05:37.123055 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:05:37.123055 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:05:37.123055 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:05:37.123055 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:05:37.123055 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:05:37.123055 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:05:37.123055 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:05:37.123055 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:05:37.123055 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e could not be found. Jun 03 10:05:37.123055 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:05:37.123055 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:05:37.123055 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:05:37.123055 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:05:37.123055 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:05:37.123055 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:05:37.123055 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:05:37.123055 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:05:37.123055 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:05:37.124567 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:05:37.124567 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:05:37.124567 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:05:37.124567 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:05:37.124567 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:05:37.124567 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:05:37.124567 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:05:37.124567 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e could not be found. Jun 03 10:05:37.124567 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:05:37.124567 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:05:37.124567 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:05:37.124567 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:05:37.124567 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:05:37.124567 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:05:37.124567 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:05:37.124567 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:05:37.124567 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e could not be found. Jun 03 10:05:37.124567 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:05:37.125775 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-c471d394-7f05-4a5e-ab39-5b1ec20a4fc8 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] Returning 404 to user: Instance 6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e could not be found. {{(pid=117648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:05:37.125775 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-c471d394-7f05-4a5e-ab39-5b1ec20a4fc8 tempest-AttachVolumeNegativeTest-1776358070 tempest-AttachVolumeNegativeTest-1776358070-project] 10.222.0.45 "GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e" status: 404 len: 111 microversion: 2.1 time: 0.036522 Jun 03 10:05:37.125775 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 496/1030] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:37 2022] GET /compute/v2.1/servers/6e6054ac-4522-4f5a-a98f-a8e2b14f1a0e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 10:05:37.321021 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-4fc606c8-c932-4abe-9bdf-64d3d861915c tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-511664426", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1925739570", "security_groups": [{"name": "tempest-secgroup-smoke-995574160"}], "block_device_mapping_v2": [{"uuid": "9cc97868-1527-4a52-83fb-d407b0860dad", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3d3b7b1c-cd6f-47da-b640-3c098fa81e51"}]}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:05:37.346022 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-3447f953-8198-4f80-a569-1bd58402fbf8 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:37.346646 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-3447f953-8198-4f80-a569-1bd58402fbf8 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] [instance: ff92db12-f23f-4be6-a091-217984a75150] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:37.353838 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3447f953-8198-4f80-a569-1bd58402fbf8 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:37.354541 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3447f953-8198-4f80-a569-1bd58402fbf8 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:37.355488 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3447f953-8198-4f80-a569-1bd58402fbf8 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:37.356097 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3447f953-8198-4f80-a569-1bd58402fbf8 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:37.544566 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.network.neutron [None req-4fc606c8-c932-4abe-9bdf-64d3d861915c tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] validate_networks() for [('3d3b7b1c-cd6f-47da-b640-3c098fa81e51', None, None, None, None, None)] {{(pid=117647) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 10:05:37.686445 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-3447f953-8198-4f80-a569-1bd58402fbf8 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d75851094d145f4907c7049d78dafed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddc37afc4d54ccab945af619507a613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:37.694294 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-3447f953-8198-4f80-a569-1bd58402fbf8 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] 10.222.0.45 "GET /compute/v2.1/servers/ff92db12-f23f-4be6-a091-217984a75150" status: 200 len: 1319 microversion: 2.1 time: 0.351906 Jun 03 10:05:37.704180 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 497/1031] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:37 2022] GET /compute/v2.1/servers/ff92db12-f23f-4be6-a091-217984a75150 => generated 1319 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:38.263928 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-4fc606c8-c932-4abe-9bdf-64d3d861915c tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Flavor limits 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 10:05:38.264443 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-4fc606c8-c932-4abe-9bdf-64d3d861915c tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Image limits 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 10:05:38.265082 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-4fc606c8-c932-4abe-9bdf-64d3d861915c tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Flavor pref 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 10:05:38.265717 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-4fc606c8-c932-4abe-9bdf-64d3d861915c tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Image pref 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 10:05:38.266437 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-4fc606c8-c932-4abe-9bdf-64d3d861915c tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 10:05:38.276750 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4fc606c8-c932-4abe-9bdf-64d3d861915c tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:38.277497 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4fc606c8-c932-4abe-9bdf-64d3d861915c tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:38.278545 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4fc606c8-c932-4abe-9bdf-64d3d861915c tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:38.279161 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4fc606c8-c932-4abe-9bdf-64d3d861915c tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:38.298085 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-4fc606c8-c932-4abe-9bdf-64d3d861915c tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Getting quotas for project 8a878ecfb9cd47b684c027beb6ad0b03. Resources: {'ram', 'cores', 'instances'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 10:05:38.302151 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-4fc606c8-c932-4abe-9bdf-64d3d861915c tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Getting quotas for user 397ff11fedcc4d17867e1d9c10fcd10f and project 8a878ecfb9cd47b684c027beb6ad0b03. Resources: {'ram', 'cores', 'instances'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 10:05:38.360831 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-4fc606c8-c932-4abe-9bdf-64d3d861915c tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Going to run 1 instances... {{(pid=117647) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 10:05:38.362959 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-4fc606c8-c932-4abe-9bdf-64d3d861915c tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: f81cb413-a285-476d-8b7a-62f99fd8fc31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9cc97868-1527-4a52-83fb-d407b0860dad',volume_size=None,volume_type=None)] {{(pid=117647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 10:05:38.498427 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-4fc606c8-c932-4abe-9bdf-64d3d861915c tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.181214 Jun 03 10:05:38.499242 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 535/1032] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jun 3 10:05:37 2022] POST /compute/v2.1/servers => generated 405 bytes in 1183 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 10:05:38.509974 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-dcb0f788-040b-46e6-9959-30d88bbf127e tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:38.510682 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-dcb0f788-040b-46e6-9959-30d88bbf127e tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: f81cb413-a285-476d-8b7a-62f99fd8fc31] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:38.654612 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-dcb0f788-040b-46e6-9959-30d88bbf127e tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:38.661820 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-dcb0f788-040b-46e6-9959-30d88bbf127e tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31" status: 200 len: 1094 microversion: 2.1 time: 0.155802 Jun 03 10:05:38.662878 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 498/1033] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:38 2022] GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31 => generated 1094 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:38.714230 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-ae0f43e7-b7e0-4565-9f06-7deea81e74c8 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:38.715189 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-ae0f43e7-b7e0-4565-9f06-7deea81e74c8 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] [instance: ff92db12-f23f-4be6-a091-217984a75150] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:38.726092 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ae0f43e7-b7e0-4565-9f06-7deea81e74c8 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:38.727285 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ae0f43e7-b7e0-4565-9f06-7deea81e74c8 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:38.728388 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ae0f43e7-b7e0-4565-9f06-7deea81e74c8 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:38.729280 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ae0f43e7-b7e0-4565-9f06-7deea81e74c8 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:38.963423 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-ae0f43e7-b7e0-4565-9f06-7deea81e74c8 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d75851094d145f4907c7049d78dafed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddc37afc4d54ccab945af619507a613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:38.975531 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-ae0f43e7-b7e0-4565-9f06-7deea81e74c8 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] 10.222.0.45 "GET /compute/v2.1/servers/ff92db12-f23f-4be6-a091-217984a75150" status: 200 len: 1319 microversion: 2.1 time: 0.266493 Jun 03 10:05:38.984785 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 536/1034] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:38 2022] GET /compute/v2.1/servers/ff92db12-f23f-4be6-a091-217984a75150 => generated 1319 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:39.679442 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-f3f8a373-b3eb-47a7-8bee-f94e6dc7bdcb tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:39.682829 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-f3f8a373-b3eb-47a7-8bee-f94e6dc7bdcb tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: f81cb413-a285-476d-8b7a-62f99fd8fc31] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:39.698459 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f3f8a373-b3eb-47a7-8bee-f94e6dc7bdcb tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:39.699220 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f3f8a373-b3eb-47a7-8bee-f94e6dc7bdcb tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:39.700208 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f3f8a373-b3eb-47a7-8bee-f94e6dc7bdcb tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:39.700815 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f3f8a373-b3eb-47a7-8bee-f94e6dc7bdcb tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:39.765643 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-2ba4a79a-af8c-4c72-8ccf-fc8cbd39a85c req-d2410b73-6235-440f-a0cd-b1e133b24861 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff92db12-f23f-4be6-a091-217984a75150", "name": "network-vif-plugged", "status": "completed", "tag": "bbb54229-7afa-4f45-b103-0476a9389d56"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:05:39.784656 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-2ba4a79a-af8c-4c72-8ccf-fc8cbd39a85c req-d2410b73-6235-440f-a0cd-b1e133b24861 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:39.785286 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-2ba4a79a-af8c-4c72-8ccf-fc8cbd39a85c req-d2410b73-6235-440f-a0cd-b1e133b24861 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:39.805949 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-2ba4a79a-af8c-4c72-8ccf-fc8cbd39a85c req-d2410b73-6235-440f-a0cd-b1e133b24861 service nova] Creating event network-vif-plugged:bbb54229-7afa-4f45-b103-0476a9389d56 for instance ff92db12-f23f-4be6-a091-217984a75150 on hv-cinder-79760 Jun 03 10:05:39.817961 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-2ba4a79a-af8c-4c72-8ccf-fc8cbd39a85c req-d2410b73-6235-440f-a0cd-b1e133b24861 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055480 Jun 03 10:05:39.818755 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 537/1035] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 10:05:39.873926 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f3f8a373-b3eb-47a7-8bee-f94e6dc7bdcb tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:39.882381 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-f3f8a373-b3eb-47a7-8bee-f94e6dc7bdcb tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31" status: 200 len: 1200 microversion: 2.1 time: 0.207145 Jun 03 10:05:39.882962 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 499/1036] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:39 2022] GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31 => generated 1200 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:40.000592 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-50672094-2db0-4347-bee2-12c595efebe8 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:40.008984 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-50672094-2db0-4347-bee2-12c595efebe8 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] [instance: ff92db12-f23f-4be6-a091-217984a75150] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:40.016754 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-50672094-2db0-4347-bee2-12c595efebe8 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:40.017317 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-50672094-2db0-4347-bee2-12c595efebe8 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:40.018216 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-50672094-2db0-4347-bee2-12c595efebe8 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:40.019592 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-50672094-2db0-4347-bee2-12c595efebe8 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:40.314673 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-50672094-2db0-4347-bee2-12c595efebe8 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d75851094d145f4907c7049d78dafed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddc37afc4d54ccab945af619507a613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:40.328573 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-50672094-2db0-4347-bee2-12c595efebe8 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] 10.222.0.45 "GET /compute/v2.1/servers/ff92db12-f23f-4be6-a091-217984a75150" status: 200 len: 1319 microversion: 2.1 time: 0.338453 Jun 03 10:05:40.330206 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 538/1037] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:39 2022] GET /compute/v2.1/servers/ff92db12-f23f-4be6-a091-217984a75150 => generated 1319 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:40.900275 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-d34c120c-ce70-49c8-a85b-302b4b712dab tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:40.900892 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-d34c120c-ce70-49c8-a85b-302b4b712dab tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: f81cb413-a285-476d-8b7a-62f99fd8fc31] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:40.916140 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d34c120c-ce70-49c8-a85b-302b4b712dab tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:40.916909 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d34c120c-ce70-49c8-a85b-302b4b712dab tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:40.918121 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d34c120c-ce70-49c8-a85b-302b4b712dab tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:40.918861 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d34c120c-ce70-49c8-a85b-302b4b712dab tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:41.234343 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d34c120c-ce70-49c8-a85b-302b4b712dab tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:41.258061 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-d34c120c-ce70-49c8-a85b-302b4b712dab tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31" status: 200 len: 1277 microversion: 2.1 time: 0.361207 Jun 03 10:05:41.262097 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 500/1038] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:40 2022] GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31 => generated 1277 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:41.348817 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-6319777e-a6c8-4b64-aea2-2c926faa212f tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:41.348817 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-6319777e-a6c8-4b64-aea2-2c926faa212f tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] [instance: ff92db12-f23f-4be6-a091-217984a75150] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:41.365598 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6319777e-a6c8-4b64-aea2-2c926faa212f tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:41.366021 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6319777e-a6c8-4b64-aea2-2c926faa212f tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:41.366683 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6319777e-a6c8-4b64-aea2-2c926faa212f tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:41.367119 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6319777e-a6c8-4b64-aea2-2c926faa212f tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:41.578092 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-6319777e-a6c8-4b64-aea2-2c926faa212f tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d75851094d145f4907c7049d78dafed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddc37afc4d54ccab945af619507a613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:41.589894 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-6319777e-a6c8-4b64-aea2-2c926faa212f tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] 10.222.0.45 "GET /compute/v2.1/servers/ff92db12-f23f-4be6-a091-217984a75150" status: 200 len: 1319 microversion: 2.1 time: 0.247927 Jun 03 10:05:41.600263 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 539/1039] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:41 2022] GET /compute/v2.1/servers/ff92db12-f23f-4be6-a091-217984a75150 => generated 1319 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:41.949622 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-ba6bf2dd-70d4-4130-9d09-961d18d4ef51 req-060a684d-7e8d-428d-8631-4acc142d8152 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f81cb413-a285-476d-8b7a-62f99fd8fc31", "tag": "4a77bec9-e2d9-4e8b-8e47-96c23798d27d"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:05:41.962006 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-ba6bf2dd-70d4-4130-9d09-961d18d4ef51 req-060a684d-7e8d-428d-8631-4acc142d8152 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:41.962636 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-ba6bf2dd-70d4-4130-9d09-961d18d4ef51 req-060a684d-7e8d-428d-8631-4acc142d8152 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:41.976506 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-ba6bf2dd-70d4-4130-9d09-961d18d4ef51 req-060a684d-7e8d-428d-8631-4acc142d8152 service nova] Creating event network-changed:4a77bec9-e2d9-4e8b-8e47-96c23798d27d for instance f81cb413-a285-476d-8b7a-62f99fd8fc31 on hv-cinder-79760 Jun 03 10:05:41.981613 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-ba6bf2dd-70d4-4130-9d09-961d18d4ef51 req-060a684d-7e8d-428d-8631-4acc142d8152 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035612 Jun 03 10:05:41.982343 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 501/1040] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:05:42.281234 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-6fb8cb50-9c28-4b0c-8e4f-ff951b0ce954 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:42.288071 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-6fb8cb50-9c28-4b0c-8e4f-ff951b0ce954 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: f81cb413-a285-476d-8b7a-62f99fd8fc31] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:42.311264 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6fb8cb50-9c28-4b0c-8e4f-ff951b0ce954 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:42.314361 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6fb8cb50-9c28-4b0c-8e4f-ff951b0ce954 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:42.316217 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6fb8cb50-9c28-4b0c-8e4f-ff951b0ce954 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:42.316836 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6fb8cb50-9c28-4b0c-8e4f-ff951b0ce954 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:42.497243 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-6fb8cb50-9c28-4b0c-8e4f-ff951b0ce954 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:42.508922 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-6fb8cb50-9c28-4b0c-8e4f-ff951b0ce954 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31" status: 200 len: 1265 microversion: 2.1 time: 0.234088 Jun 03 10:05:42.509625 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 540/1041] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:42 2022] GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31 => generated 1265 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:42.607237 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-293e09a1-abc8-48a1-9bbd-6dac2c042ef4 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:42.608164 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-293e09a1-abc8-48a1-9bbd-6dac2c042ef4 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] [instance: ff92db12-f23f-4be6-a091-217984a75150] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:42.614757 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-293e09a1-abc8-48a1-9bbd-6dac2c042ef4 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:42.615625 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-293e09a1-abc8-48a1-9bbd-6dac2c042ef4 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:42.616807 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-293e09a1-abc8-48a1-9bbd-6dac2c042ef4 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:42.617493 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-293e09a1-abc8-48a1-9bbd-6dac2c042ef4 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:42.760454 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-293e09a1-abc8-48a1-9bbd-6dac2c042ef4 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d75851094d145f4907c7049d78dafed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddc37afc4d54ccab945af619507a613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:42.770032 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-293e09a1-abc8-48a1-9bbd-6dac2c042ef4 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] 10.222.0.45 "GET /compute/v2.1/servers/ff92db12-f23f-4be6-a091-217984a75150" status: 200 len: 1507 microversion: 2.1 time: 0.166873 Jun 03 10:05:42.771801 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 502/1042] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:42 2022] GET /compute/v2.1/servers/ff92db12-f23f-4be6-a091-217984a75150 => generated 1507 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:42.788134 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-28543501-c489-4e97-925e-72e3a109f693 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9147b8be-f3c1-4510-811b-9d6cd21da57d", "device": "/dev/sdb"}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:05:42.789369 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-28543501-c489-4e97-925e-72e3a109f693 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] [instance: ff92db12-f23f-4be6-a091-217984a75150] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:42.795882 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-28543501-c489-4e97-925e-72e3a109f693 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:42.796983 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-28543501-c489-4e97-925e-72e3a109f693 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:42.798138 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-28543501-c489-4e97-925e-72e3a109f693 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:42.798796 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-28543501-c489-4e97-925e-72e3a109f693 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:43.103338 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-28543501-c489-4e97-925e-72e3a109f693 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] 10.222.0.45 "POST /compute/v2.1/servers/ff92db12-f23f-4be6-a091-217984a75150/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.319828 Jun 03 10:05:43.104071 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 541/1043] 10.222.0.45 () {60 vars in 1322 bytes} [Fri Jun 3 10:05:42 2022] POST /compute/v2.1/servers/ff92db12-f23f-4be6-a091-217984a75150/os-volume_attachments => generated 194 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 10:05:43.528105 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-3eb05126-0e8e-4c2f-817c-7e41ab6e6bca tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:43.528722 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-3eb05126-0e8e-4c2f-817c-7e41ab6e6bca tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: f81cb413-a285-476d-8b7a-62f99fd8fc31] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:43.534803 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3eb05126-0e8e-4c2f-817c-7e41ab6e6bca tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:43.535267 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3eb05126-0e8e-4c2f-817c-7e41ab6e6bca tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:43.536578 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3eb05126-0e8e-4c2f-817c-7e41ab6e6bca tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:43.537008 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-3eb05126-0e8e-4c2f-817c-7e41ab6e6bca tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:43.685868 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-3eb05126-0e8e-4c2f-817c-7e41ab6e6bca tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:43.693316 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-3eb05126-0e8e-4c2f-817c-7e41ab6e6bca tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31" status: 200 len: 1265 microversion: 2.1 time: 0.171131 Jun 03 10:05:43.693909 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 503/1044] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:43 2022] GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:44.087749 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-933afc03-8e3a-41bf-a5f1-761110261b8e tempest-VolumesTestJSON-224146307 tempest-VolumesTestJSON-224146307-project] Calling method '.version_select at 0x7f5036a76e50>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:44.133489 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-933afc03-8e3a-41bf-a5f1-761110261b8e tempest-VolumesTestJSON-224146307 tempest-VolumesTestJSON-224146307-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/1052d698-5fc3-4804-b564-48d9af604fa9" status: 200 len: 350 microversion: 2.1 time: 0.050807 Jun 03 10:05:44.134073 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 542/1045] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Jun 3 10:05:44 2022] GET /compute/v2.1/os-volumes/1052d698-5fc3-4804-b564-48d9af604fa9 => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:05:44.709297 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-0d599390-bc0e-4f6e-9add-3a1dc55214e0 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:44.709950 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-0d599390-bc0e-4f6e-9add-3a1dc55214e0 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: f81cb413-a285-476d-8b7a-62f99fd8fc31] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:44.712352 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:05:44.717762 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0d599390-bc0e-4f6e-9add-3a1dc55214e0 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:44.718225 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0d599390-bc0e-4f6e-9add-3a1dc55214e0 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:44.718989 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0d599390-bc0e-4f6e-9add-3a1dc55214e0 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:44.719463 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0d599390-bc0e-4f6e-9add-3a1dc55214e0 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:44.856050 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-0d599390-bc0e-4f6e-9add-3a1dc55214e0 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:44.863548 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-0d599390-bc0e-4f6e-9add-3a1dc55214e0 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31" status: 200 len: 1265 microversion: 2.1 time: 0.158096 Jun 03 10:05:44.864891 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 504/1046] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:44 2022] GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:45.471927 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-8cf67ce2-fed8-4496-8cd0-e450e7e35828 tempest-VolumesTestJSON-224146307 tempest-VolumesTestJSON-224146307-project] Calling method '.version_select at 0x7f5036a62e50>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:45.517560 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-8cf67ce2-fed8-4496-8cd0-e450e7e35828 tempest-VolumesTestJSON-224146307 tempest-VolumesTestJSON-224146307-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/13a34be8-b4c6-4c07-bab4-b78be385d3e6" status: 200 len: 351 microversion: 2.1 time: 0.051041 Jun 03 10:05:45.518152 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 543/1047] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Jun 3 10:05:45 2022] GET /compute/v2.1/os-volumes/13a34be8-b4c6-4c07-bab4-b78be385d3e6 => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:05:45.881067 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-71433cab-d85c-4dfd-8652-50e15de022f8 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:45.881679 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-71433cab-d85c-4dfd-8652-50e15de022f8 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: f81cb413-a285-476d-8b7a-62f99fd8fc31] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:45.888205 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-71433cab-d85c-4dfd-8652-50e15de022f8 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:45.888717 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-71433cab-d85c-4dfd-8652-50e15de022f8 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:45.889474 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-71433cab-d85c-4dfd-8652-50e15de022f8 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:45.889939 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-71433cab-d85c-4dfd-8652-50e15de022f8 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:46.020287 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-71433cab-d85c-4dfd-8652-50e15de022f8 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:46.027653 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-71433cab-d85c-4dfd-8652-50e15de022f8 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31" status: 200 len: 1265 microversion: 2.1 time: 0.151115 Jun 03 10:05:46.028222 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 505/1048] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:45 2022] GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:46.833941 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-bec90b99-4420-448e-9a6f-a7dff3179663 tempest-VolumesTestJSON-224146307 tempest-VolumesTestJSON-224146307-project] Calling method '.version_select at 0x7f5036ae9ca0>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:46.879379 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-bec90b99-4420-448e-9a6f-a7dff3179663 tempest-VolumesTestJSON-224146307 tempest-VolumesTestJSON-224146307-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/8741addd-2198-4845-b0cd-ed905272e895" status: 200 len: 351 microversion: 2.1 time: 0.049709 Jun 03 10:05:46.880555 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 544/1049] 10.222.0.45 () {58 vars in 1244 bytes} [Fri Jun 3 10:05:46 2022] GET /compute/v2.1/os-volumes/8741addd-2198-4845-b0cd-ed905272e895 => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:05:46.891346 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-f1433293-99d8-472d-b79e-8a38ad739acd tempest-VolumesTestJSON-224146307 tempest-VolumesTestJSON-224146307-project] Calling method '.version_select at 0x7f5036dad9d0>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:46.970476 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-f1433293-99d8-472d-b79e-8a38ad739acd tempest-VolumesTestJSON-224146307 tempest-VolumesTestJSON-224146307-project] 10.222.0.45 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.082799 Jun 03 10:05:46.971042 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 506/1050] 10.222.0.45 () {58 vars in 1133 bytes} [Fri Jun 3 10:05:46 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:46.983288 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-1e370e13-8385-42a3-afe7-1e5318380640 tempest-VolumesTestJSON-224146307 tempest-VolumesTestJSON-224146307-project] Calling method '.version_select at 0x7f5036e04ee0>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:47.044442 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-63b23395-6c64-4fc4-9b3b-dd209b3435d9 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:47.045164 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-63b23395-6c64-4fc4-9b3b-dd209b3435d9 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: f81cb413-a285-476d-8b7a-62f99fd8fc31] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:47.051299 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-63b23395-6c64-4fc4-9b3b-dd209b3435d9 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:47.052272 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-63b23395-6c64-4fc4-9b3b-dd209b3435d9 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:47.053216 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-63b23395-6c64-4fc4-9b3b-dd209b3435d9 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:47.053470 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-63b23395-6c64-4fc4-9b3b-dd209b3435d9 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:47.065141 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-1e370e13-8385-42a3-afe7-1e5318380640 tempest-VolumesTestJSON-224146307 tempest-VolumesTestJSON-224146307-project] 10.222.0.45 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.085545 Jun 03 10:05:47.065810 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 545/1051] 10.222.0.45 () {58 vars in 1148 bytes} [Fri Jun 3 10:05:46 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:05:47.077185 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-cc9a2861-226c-42bc-b1bd-543da3a095ad tempest-VolumesTestJSON-224146307 tempest-VolumesTestJSON-224146307-project] Calling method '.version_select at 0x7f5036b1f4c0>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:47.157489 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-cc9a2861-226c-42bc-b1bd-543da3a095ad tempest-VolumesTestJSON-224146307 tempest-VolumesTestJSON-224146307-project] 10.222.0.45 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.083980 Jun 03 10:05:47.158198 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 546/1052] 10.222.0.45 () {58 vars in 1133 bytes} [Fri Jun 3 10:05:47 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:05:47.169639 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-37b581f3-9dbc-45bd-8e1d-4774a842cda5 tempest-VolumesTestJSON-224146307 tempest-VolumesTestJSON-224146307-project] Calling method '.version_select at 0x7f5036ad3160>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:47.185867 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-63b23395-6c64-4fc4-9b3b-dd209b3435d9 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:47.193648 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-63b23395-6c64-4fc4-9b3b-dd209b3435d9 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31" status: 200 len: 1265 microversion: 2.1 time: 0.153106 Jun 03 10:05:47.194311 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 507/1053] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:47 2022] GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:05:47.249775 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-37b581f3-9dbc-45bd-8e1d-4774a842cda5 tempest-VolumesTestJSON-224146307 tempest-VolumesTestJSON-224146307-project] 10.222.0.45 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.083741 Jun 03 10:05:47.250355 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 547/1054] 10.222.0.45 () {58 vars in 1166 bytes} [Fri Jun 3 10:05:47 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 10:05:47.261677 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-bff0fe13-c3ae-4ea9-96eb-b5a0217d5804 tempest-VolumesTestJSON-224146307 tempest-VolumesTestJSON-224146307-project] Calling method '.version_select at 0x7f5036bda430>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:47.341239 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-bff0fe13-c3ae-4ea9-96eb-b5a0217d5804 tempest-VolumesTestJSON-224146307 tempest-VolumesTestJSON-224146307-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.083206 Jun 03 10:05:47.341844 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 508/1055] 10.222.0.45 () {58 vars in 1169 bytes} [Fri Jun 3 10:05:47 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:05:47.353870 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-8d16cf48-af7c-49ee-b628-059731b66787 tempest-VolumesTestJSON-224146307 tempest-VolumesTestJSON-224146307-project] Calling method '.version_select at 0x7f5036ad3940>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:47.434191 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-8d16cf48-af7c-49ee-b628-059731b66787 tempest-VolumesTestJSON-224146307 tempest-VolumesTestJSON-224146307-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.083979 Jun 03 10:05:47.434799 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 548/1056] 10.222.0.45 () {58 vars in 1154 bytes} [Fri Jun 3 10:05:47 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:47.449889 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-99367880-a5d9-4bf6-a8d9-a5d6b92c1ff3 tempest-VolumesTestJSON-224146307 tempest-VolumesTestJSON-224146307-project] Calling method '.version_select at 0x7f5036c7d670>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:47.537961 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-99367880-a5d9-4bf6-a8d9-a5d6b92c1ff3 tempest-VolumesTestJSON-224146307 tempest-VolumesTestJSON-224146307-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.091454 Jun 03 10:05:47.538551 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 509/1057] 10.222.0.45 () {58 vars in 1187 bytes} [Fri Jun 3 10:05:47 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:05:47.551214 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-5b41cc90-e111-4f84-acdc-acd594aa8dab tempest-VolumesTestJSON-224146307 tempest-VolumesTestJSON-224146307-project] Calling method '.version_select at 0x7f5036d67280>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:47.635826 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-5b41cc90-e111-4f84-acdc-acd594aa8dab tempest-VolumesTestJSON-224146307 tempest-VolumesTestJSON-224146307-project] 10.222.0.45 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.088239 Jun 03 10:05:47.636422 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 549/1058] 10.222.0.45 () {58 vars in 1154 bytes} [Fri Jun 3 10:05:47 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:48.210936 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-927e6bf7-3c9d-41f9-aa65-acd868b12c4d tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:48.211523 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-927e6bf7-3c9d-41f9-aa65-acd868b12c4d tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: f81cb413-a285-476d-8b7a-62f99fd8fc31] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:48.218283 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-927e6bf7-3c9d-41f9-aa65-acd868b12c4d tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:48.218739 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-927e6bf7-3c9d-41f9-aa65-acd868b12c4d tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:48.219512 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-927e6bf7-3c9d-41f9-aa65-acd868b12c4d tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:48.219955 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-927e6bf7-3c9d-41f9-aa65-acd868b12c4d tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:48.346376 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-927e6bf7-3c9d-41f9-aa65-acd868b12c4d tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:48.353712 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-927e6bf7-3c9d-41f9-aa65-acd868b12c4d tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31" status: 200 len: 1265 microversion: 2.1 time: 0.147341 Jun 03 10:05:48.354296 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 510/1059] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:48 2022] GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:49.368316 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell0:SELECT=4 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:05:49.369079 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell0:SELECT=12 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:05:49.373093 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-bc29c865-9979-4ee6-ac82-0b49db0c7987 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:49.373843 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-bc29c865-9979-4ee6-ac82-0b49db0c7987 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: f81cb413-a285-476d-8b7a-62f99fd8fc31] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:49.376186 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=6 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:05:49.383121 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bc29c865-9979-4ee6-ac82-0b49db0c7987 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:49.383571 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bc29c865-9979-4ee6-ac82-0b49db0c7987 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:49.384357 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bc29c865-9979-4ee6-ac82-0b49db0c7987 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:49.384797 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bc29c865-9979-4ee6-ac82-0b49db0c7987 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:49.524194 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-bc29c865-9979-4ee6-ac82-0b49db0c7987 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:49.531677 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-bc29c865-9979-4ee6-ac82-0b49db0c7987 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31" status: 200 len: 1265 microversion: 2.1 time: 0.164682 Jun 03 10:05:49.532232 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 550/1060] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:49 2022] GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:50.552089 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-625554b4-e834-42c3-9786-eeea56b2bc55 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:50.552706 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-625554b4-e834-42c3-9786-eeea56b2bc55 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: f81cb413-a285-476d-8b7a-62f99fd8fc31] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:50.554883 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell0:SELECT=4 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:05:50.560941 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-625554b4-e834-42c3-9786-eeea56b2bc55 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:50.561370 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-625554b4-e834-42c3-9786-eeea56b2bc55 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:50.562196 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-625554b4-e834-42c3-9786-eeea56b2bc55 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:50.562625 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-625554b4-e834-42c3-9786-eeea56b2bc55 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:50.700351 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-625554b4-e834-42c3-9786-eeea56b2bc55 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:50.708687 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-625554b4-e834-42c3-9786-eeea56b2bc55 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31" status: 200 len: 1265 microversion: 2.1 time: 0.160491 Jun 03 10:05:50.709462 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 511/1061] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:50 2022] GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:51.725932 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-32d255fd-34a0-4fb7-8971-ea30bed78086 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:51.726550 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-32d255fd-34a0-4fb7-8971-ea30bed78086 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: f81cb413-a285-476d-8b7a-62f99fd8fc31] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:51.736423 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-32d255fd-34a0-4fb7-8971-ea30bed78086 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:51.736887 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-32d255fd-34a0-4fb7-8971-ea30bed78086 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:51.737673 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-32d255fd-34a0-4fb7-8971-ea30bed78086 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:51.738145 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-32d255fd-34a0-4fb7-8971-ea30bed78086 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:51.878475 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-32d255fd-34a0-4fb7-8971-ea30bed78086 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:51.885969 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-32d255fd-34a0-4fb7-8971-ea30bed78086 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31" status: 200 len: 1265 microversion: 2.1 time: 0.164492 Jun 03 10:05:51.886531 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 551/1062] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:51 2022] GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:52.902364 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-d0295ac7-879a-4fe5-a7a5-0a2bcc3245b1 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:52.902981 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-d0295ac7-879a-4fe5-a7a5-0a2bcc3245b1 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: f81cb413-a285-476d-8b7a-62f99fd8fc31] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:52.909715 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d0295ac7-879a-4fe5-a7a5-0a2bcc3245b1 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:52.910662 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d0295ac7-879a-4fe5-a7a5-0a2bcc3245b1 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:52.912079 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d0295ac7-879a-4fe5-a7a5-0a2bcc3245b1 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:52.912889 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d0295ac7-879a-4fe5-a7a5-0a2bcc3245b1 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:53.078194 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-d0295ac7-879a-4fe5-a7a5-0a2bcc3245b1 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:53.088781 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-d0295ac7-879a-4fe5-a7a5-0a2bcc3245b1 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31" status: 200 len: 1265 microversion: 2.1 time: 0.190071 Jun 03 10:05:53.089349 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 512/1063] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:52 2022] GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31 => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:54.106697 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-1ff32fd9-8dd9-4d6d-8dfd-77abf09df17c tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:54.107303 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-1ff32fd9-8dd9-4d6d-8dfd-77abf09df17c tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: f81cb413-a285-476d-8b7a-62f99fd8fc31] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:54.114186 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1ff32fd9-8dd9-4d6d-8dfd-77abf09df17c tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:54.114856 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1ff32fd9-8dd9-4d6d-8dfd-77abf09df17c tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:54.115827 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1ff32fd9-8dd9-4d6d-8dfd-77abf09df17c tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:54.116271 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1ff32fd9-8dd9-4d6d-8dfd-77abf09df17c tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:54.257375 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-1ff32fd9-8dd9-4d6d-8dfd-77abf09df17c tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:54.265098 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-1ff32fd9-8dd9-4d6d-8dfd-77abf09df17c tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31" status: 200 len: 1265 microversion: 2.1 time: 0.162986 Jun 03 10:05:54.274263 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 552/1064] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:54 2022] GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:55.281471 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-a043087a-cd70-4cb6-9c45-dafebffdecde tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:55.282223 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-a043087a-cd70-4cb6-9c45-dafebffdecde tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: f81cb413-a285-476d-8b7a-62f99fd8fc31] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:55.289026 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a043087a-cd70-4cb6-9c45-dafebffdecde tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:55.289478 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a043087a-cd70-4cb6-9c45-dafebffdecde tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:55.290283 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a043087a-cd70-4cb6-9c45-dafebffdecde tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:55.290790 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a043087a-cd70-4cb6-9c45-dafebffdecde tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:55.293397 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell1:SELECT=100 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:05:55.427125 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-a043087a-cd70-4cb6-9c45-dafebffdecde tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:55.434693 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-a043087a-cd70-4cb6-9c45-dafebffdecde tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31" status: 200 len: 1265 microversion: 2.1 time: 0.157030 Jun 03 10:05:55.435259 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 513/1065] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:55 2022] GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:56.451140 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-93b59fb3-e3ed-4543-b9a4-6dd982b7ebcf tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:56.451748 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-93b59fb3-e3ed-4543-b9a4-6dd982b7ebcf tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: f81cb413-a285-476d-8b7a-62f99fd8fc31] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:56.458716 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-93b59fb3-e3ed-4543-b9a4-6dd982b7ebcf tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:56.459158 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-93b59fb3-e3ed-4543-b9a4-6dd982b7ebcf tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:56.459912 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-93b59fb3-e3ed-4543-b9a4-6dd982b7ebcf tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:56.460338 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-93b59fb3-e3ed-4543-b9a4-6dd982b7ebcf tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:56.596741 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-93b59fb3-e3ed-4543-b9a4-6dd982b7ebcf tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:56.604902 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-93b59fb3-e3ed-4543-b9a4-6dd982b7ebcf tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31" status: 200 len: 1265 microversion: 2.1 time: 0.157613 Jun 03 10:05:56.605467 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 553/1066] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:56 2022] GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:57.391368 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-c0f58e62-99a1-48fc-ae9a-728d95f97846 req-b99153e7-ef7e-4ef7-aa92-5a74eb2e2f76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f81cb413-a285-476d-8b7a-62f99fd8fc31", "name": "network-vif-plugged", "status": "completed", "tag": "4a77bec9-e2d9-4e8b-8e47-96c23798d27d"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:05:57.400819 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-c0f58e62-99a1-48fc-ae9a-728d95f97846 req-b99153e7-ef7e-4ef7-aa92-5a74eb2e2f76 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:57.401281 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-c0f58e62-99a1-48fc-ae9a-728d95f97846 req-b99153e7-ef7e-4ef7-aa92-5a74eb2e2f76 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:57.413216 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-c0f58e62-99a1-48fc-ae9a-728d95f97846 req-b99153e7-ef7e-4ef7-aa92-5a74eb2e2f76 service nova] Creating event network-vif-plugged:4a77bec9-e2d9-4e8b-8e47-96c23798d27d for instance f81cb413-a285-476d-8b7a-62f99fd8fc31 on hv-cinder-79760 Jun 03 10:05:57.418201 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-c0f58e62-99a1-48fc-ae9a-728d95f97846 req-b99153e7-ef7e-4ef7-aa92-5a74eb2e2f76 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031330 Jun 03 10:05:57.418798 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 514/1067] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:05:57.622564 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-de22853c-380c-4771-83f7-2c2b0623b2e7 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:57.623178 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-de22853c-380c-4771-83f7-2c2b0623b2e7 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: f81cb413-a285-476d-8b7a-62f99fd8fc31] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:57.629892 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-de22853c-380c-4771-83f7-2c2b0623b2e7 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:57.630605 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-de22853c-380c-4771-83f7-2c2b0623b2e7 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:57.631345 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-de22853c-380c-4771-83f7-2c2b0623b2e7 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:57.631870 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-de22853c-380c-4771-83f7-2c2b0623b2e7 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:57.782652 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-de22853c-380c-4771-83f7-2c2b0623b2e7 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:57.791049 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-de22853c-380c-4771-83f7-2c2b0623b2e7 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31" status: 200 len: 1265 microversion: 2.1 time: 0.172969 Jun 03 10:05:57.791635 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 554/1068] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:57 2022] GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:58.646576 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-ed110216-d5a3-4a69-b99b-f4edc18517c6 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:58.647594 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-ed110216-d5a3-4a69-b99b-f4edc18517c6 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:58.653912 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ed110216-d5a3-4a69-b99b-f4edc18517c6 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:58.654361 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ed110216-d5a3-4a69-b99b-f4edc18517c6 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:58.655122 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ed110216-d5a3-4a69-b99b-f4edc18517c6 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:58.655562 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ed110216-d5a3-4a69-b99b-f4edc18517c6 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:58.685917 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-ed110216-d5a3-4a69-b99b-f4edc18517c6 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044065 Jun 03 10:05:58.686457 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 515/1069] 10.222.0.45 () {60 vars in 1342 bytes} [Fri Jun 3 10:05:58 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:05:58.743519 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-6ffdf4a2-c38f-4ff4-8857-1325a3407d2b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:58.744026 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-6ffdf4a2-c38f-4ff4-8857-1325a3407d2b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:58.750400 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6ffdf4a2-c38f-4ff4-8857-1325a3407d2b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:58.750991 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6ffdf4a2-c38f-4ff4-8857-1325a3407d2b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:58.751624 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6ffdf4a2-c38f-4ff4-8857-1325a3407d2b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:58.752063 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6ffdf4a2-c38f-4ff4-8857-1325a3407d2b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:58.777960 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-6ffdf4a2-c38f-4ff4-8857-1325a3407d2b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Going to try to terminate instance {{(pid=117647) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 10:05:58.807934 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-89b035a0-6f67-45f9-99cc-464c96a9df1d tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:58.808515 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-89b035a0-6f67-45f9-99cc-464c96a9df1d tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: f81cb413-a285-476d-8b7a-62f99fd8fc31] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:58.812756 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:05:58.814611 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-89b035a0-6f67-45f9-99cc-464c96a9df1d tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:58.815085 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-89b035a0-6f67-45f9-99cc-464c96a9df1d tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:58.815835 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-89b035a0-6f67-45f9-99cc-464c96a9df1d tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:58.816274 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-89b035a0-6f67-45f9-99cc-464c96a9df1d tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:58.855335 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-6ffdf4a2-c38f-4ff4-8857-1325a3407d2b tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "DELETE /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 204 len: 0 microversion: 2.20 time: 0.115357 Jun 03 10:05:58.856101 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 555/1070] 10.222.0.45 () {60 vars in 1279 bytes} [Fri Jun 3 10:05:58 2022] DELETE /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 03 10:05:58.864859 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-a001db86-0a02-4ac9-a59d-89d9baeda5bd tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:05:58.865846 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-a001db86-0a02-4ac9-a59d-89d9baeda5bd tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:05:58.872459 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a001db86-0a02-4ac9-a59d-89d9baeda5bd tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:58.872912 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a001db86-0a02-4ac9-a59d-89d9baeda5bd tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:58.873837 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a001db86-0a02-4ac9-a59d-89d9baeda5bd tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:05:58.874305 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a001db86-0a02-4ac9-a59d-89d9baeda5bd tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:05:58.989143 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-89b035a0-6f67-45f9-99cc-464c96a9df1d tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:58.996726 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-89b035a0-6f67-45f9-99cc-464c96a9df1d tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31" status: 200 len: 1265 microversion: 2.1 time: 0.192605 Jun 03 10:05:58.997385 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 516/1071] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:05:58 2022] GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31 => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:05:59.033071 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-a001db86-0a02-4ac9-a59d-89d9baeda5bd tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:59.042737 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-a001db86-0a02-4ac9-a59d-89d9baeda5bd tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:59.044439 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-a001db86-0a02-4ac9-a59d-89d9baeda5bd tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:05:59.045822 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-a001db86-0a02-4ac9-a59d-89d9baeda5bd tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1724 microversion: 2.20 time: 0.185633 Jun 03 10:05:59.046387 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 556/1072] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:05:58 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 10:06:00.012358 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-c73b6aaa-2368-42ec-b2b7-c9c63d1dc3d8 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:00.013010 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-c73b6aaa-2368-42ec-b2b7-c9c63d1dc3d8 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: f81cb413-a285-476d-8b7a-62f99fd8fc31] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:00.020414 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c73b6aaa-2368-42ec-b2b7-c9c63d1dc3d8 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:00.020874 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c73b6aaa-2368-42ec-b2b7-c9c63d1dc3d8 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:00.021655 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c73b6aaa-2368-42ec-b2b7-c9c63d1dc3d8 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:00.022137 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c73b6aaa-2368-42ec-b2b7-c9c63d1dc3d8 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:00.067234 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-5ee5c37d-ecaa-4f09-9535-027f12f67aad tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:00.068463 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-5ee5c37d-ecaa-4f09-9535-027f12f67aad tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:00.076117 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5ee5c37d-ecaa-4f09-9535-027f12f67aad tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:00.076921 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5ee5c37d-ecaa-4f09-9535-027f12f67aad tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:00.077907 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5ee5c37d-ecaa-4f09-9535-027f12f67aad tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:00.078513 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5ee5c37d-ecaa-4f09-9535-027f12f67aad tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:00.204913 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-c73b6aaa-2368-42ec-b2b7-c9c63d1dc3d8 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:00.213949 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-c73b6aaa-2368-42ec-b2b7-c9c63d1dc3d8 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31" status: 200 len: 1265 microversion: 2.1 time: 0.205006 Jun 03 10:06:00.219332 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 517/1073] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:00 2022] GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31 => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:00.250693 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-5ee5c37d-ecaa-4f09-9535-027f12f67aad tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:00.258873 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-5ee5c37d-ecaa-4f09-9535-027f12f67aad tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:00.260384 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-5ee5c37d-ecaa-4f09-9535-027f12f67aad tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:00.261582 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-5ee5c37d-ecaa-4f09-9535-027f12f67aad tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1724 microversion: 2.20 time: 0.199176 Jun 03 10:06:00.262175 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 557/1074] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:06:00 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1724 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 10:06:01.230539 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-1cbea105-19ef-4070-8cf3-626730a7700e tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:01.231148 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-1cbea105-19ef-4070-8cf3-626730a7700e tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: f81cb413-a285-476d-8b7a-62f99fd8fc31] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:01.237653 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1cbea105-19ef-4070-8cf3-626730a7700e tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:01.238144 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1cbea105-19ef-4070-8cf3-626730a7700e tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:01.238926 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1cbea105-19ef-4070-8cf3-626730a7700e tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:01.239369 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1cbea105-19ef-4070-8cf3-626730a7700e tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:01.280566 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-22466337-aa1a-452f-8365-9340ddec20d2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:01.281185 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-22466337-aa1a-452f-8365-9340ddec20d2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:01.288076 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-22466337-aa1a-452f-8365-9340ddec20d2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:01.288526 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-22466337-aa1a-452f-8365-9340ddec20d2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:01.289297 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-22466337-aa1a-452f-8365-9340ddec20d2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:01.289734 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-22466337-aa1a-452f-8365-9340ddec20d2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:01.422511 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-1cbea105-19ef-4070-8cf3-626730a7700e tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:01.430289 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-1cbea105-19ef-4070-8cf3-626730a7700e tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31" status: 200 len: 1265 microversion: 2.1 time: 0.203551 Jun 03 10:06:01.431131 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 518/1075] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:01 2022] GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31 => generated 1265 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:01.454864 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-22466337-aa1a-452f-8365-9340ddec20d2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:01.463670 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-22466337-aa1a-452f-8365-9340ddec20d2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:01.465182 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-22466337-aa1a-452f-8365-9340ddec20d2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:01.466388 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-22466337-aa1a-452f-8365-9340ddec20d2 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1724 microversion: 2.20 time: 0.189775 Jun 03 10:06:01.466946 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 558/1076] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:06:01 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 10:06:02.446509 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-f58ed4a2-b34b-4429-8c52-59c80a9c6d3d tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:02.447163 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-f58ed4a2-b34b-4429-8c52-59c80a9c6d3d tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: f81cb413-a285-476d-8b7a-62f99fd8fc31] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:02.453854 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f58ed4a2-b34b-4429-8c52-59c80a9c6d3d tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:02.454307 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f58ed4a2-b34b-4429-8c52-59c80a9c6d3d tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:02.455095 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f58ed4a2-b34b-4429-8c52-59c80a9c6d3d tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:02.455522 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f58ed4a2-b34b-4429-8c52-59c80a9c6d3d tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:02.484266 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-e9a66dd8-1917-405d-badc-094e8dbaa380 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:02.484881 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-e9a66dd8-1917-405d-badc-094e8dbaa380 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:02.491518 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e9a66dd8-1917-405d-badc-094e8dbaa380 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:02.491972 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e9a66dd8-1917-405d-badc-094e8dbaa380 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:02.492791 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e9a66dd8-1917-405d-badc-094e8dbaa380 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:02.493231 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e9a66dd8-1917-405d-badc-094e8dbaa380 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:02.635747 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f58ed4a2-b34b-4429-8c52-59c80a9c6d3d tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:02.643187 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-f58ed4a2-b34b-4429-8c52-59c80a9c6d3d tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31" status: 200 len: 1265 microversion: 2.1 time: 0.200511 Jun 03 10:06:02.643764 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 519/1077] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:02 2022] GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31 => generated 1265 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:02.664831 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-e9a66dd8-1917-405d-badc-094e8dbaa380 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:02.672856 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-e9a66dd8-1917-405d-badc-094e8dbaa380 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:02.674413 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-e9a66dd8-1917-405d-badc-094e8dbaa380 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:02.675567 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-e9a66dd8-1917-405d-badc-094e8dbaa380 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1724 microversion: 2.20 time: 0.195133 Jun 03 10:06:02.676150 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 559/1078] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:06:02 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 10:06:03.660811 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-374b0086-b9bc-4d76-9c96-d7fe329dfbb3 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:03.661372 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-374b0086-b9bc-4d76-9c96-d7fe329dfbb3 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: f81cb413-a285-476d-8b7a-62f99fd8fc31] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:03.668061 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-374b0086-b9bc-4d76-9c96-d7fe329dfbb3 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:03.668477 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-374b0086-b9bc-4d76-9c96-d7fe329dfbb3 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:03.669239 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-374b0086-b9bc-4d76-9c96-d7fe329dfbb3 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:03.669674 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-374b0086-b9bc-4d76-9c96-d7fe329dfbb3 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:03.694882 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-aefe452d-f2ff-45ab-ba18-7c875008903e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:03.695506 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-aefe452d-f2ff-45ab-ba18-7c875008903e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:03.703021 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-aefe452d-f2ff-45ab-ba18-7c875008903e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:03.703797 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-aefe452d-f2ff-45ab-ba18-7c875008903e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:03.705181 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-aefe452d-f2ff-45ab-ba18-7c875008903e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:03.706021 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-aefe452d-f2ff-45ab-ba18-7c875008903e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:04.082423 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-374b0086-b9bc-4d76-9c96-d7fe329dfbb3 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:04.090403 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-374b0086-b9bc-4d76-9c96-d7fe329dfbb3 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31" status: 200 len: 1265 microversion: 2.1 time: 0.434061 Jun 03 10:06:04.091214 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 520/1079] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:03 2022] GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31 => generated 1265 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:04.108706 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-aefe452d-f2ff-45ab-ba18-7c875008903e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:04.117415 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-aefe452d-f2ff-45ab-ba18-7c875008903e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:04.119030 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-aefe452d-f2ff-45ab-ba18-7c875008903e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:04.120217 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-aefe452d-f2ff-45ab-ba18-7c875008903e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1724 microversion: 2.20 time: 0.430525 Jun 03 10:06:04.120830 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 560/1080] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:06:03 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1724 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 10:06:05.106815 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-9cd73e41-4b73-470e-8964-c1f0dee8ae3b tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:05.107426 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-9cd73e41-4b73-470e-8964-c1f0dee8ae3b tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: f81cb413-a285-476d-8b7a-62f99fd8fc31] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:05.114305 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9cd73e41-4b73-470e-8964-c1f0dee8ae3b tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:05.114758 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9cd73e41-4b73-470e-8964-c1f0dee8ae3b tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:05.115540 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9cd73e41-4b73-470e-8964-c1f0dee8ae3b tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:05.116013 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-9cd73e41-4b73-470e-8964-c1f0dee8ae3b tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:05.139434 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-feeeee5c-7304-434d-ba69-282c9752a1cc tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:05.140286 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-feeeee5c-7304-434d-ba69-282c9752a1cc tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:05.148026 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-feeeee5c-7304-434d-ba69-282c9752a1cc tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:05.148699 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-feeeee5c-7304-434d-ba69-282c9752a1cc tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:05.149556 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-feeeee5c-7304-434d-ba69-282c9752a1cc tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:05.150807 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-feeeee5c-7304-434d-ba69-282c9752a1cc tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:05.309698 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-9cd73e41-4b73-470e-8964-c1f0dee8ae3b tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:05.319258 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-9cd73e41-4b73-470e-8964-c1f0dee8ae3b tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31" status: 200 len: 1453 microversion: 2.1 time: 0.216230 Jun 03 10:06:05.330888 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 521/1081] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:05 2022] GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31 => generated 1453 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:05.337400 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-c9697e94-e044-4cf4-8d23-838bc2017e86 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:05.338237 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-c9697e94-e044-4cf4-8d23-838bc2017e86 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: f81cb413-a285-476d-8b7a-62f99fd8fc31] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:05.338857 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-feeeee5c-7304-434d-ba69-282c9752a1cc tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:05.345565 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c9697e94-e044-4cf4-8d23-838bc2017e86 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:05.346060 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c9697e94-e044-4cf4-8d23-838bc2017e86 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:05.346869 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c9697e94-e044-4cf4-8d23-838bc2017e86 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:05.347314 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c9697e94-e044-4cf4-8d23-838bc2017e86 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:05.352462 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-feeeee5c-7304-434d-ba69-282c9752a1cc tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:05.355928 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-feeeee5c-7304-434d-ba69-282c9752a1cc tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c216711b9e9b45f09f4917fe7b8275ab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a937f473cd1b44bc8d628c7cadb18856', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:05.357288 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-feeeee5c-7304-434d-ba69-282c9752a1cc tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 200 len: 1724 microversion: 2.20 time: 0.221934 Jun 03 10:06:05.358406 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 561/1082] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:06:05 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 03 10:06:05.494029 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-c9697e94-e044-4cf4-8d23-838bc2017e86 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:05.501762 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-c9697e94-e044-4cf4-8d23-838bc2017e86 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31" status: 200 len: 1453 microversion: 2.1 time: 0.169554 Jun 03 10:06:05.502343 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 522/1083] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:05 2022] GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31 => generated 1453 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:05.695302 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-83bdafbd-5b28-443a-bc28-3a6330050029 req-dfee2c5f-147d-40cb-955f-7cfe9196e189 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02de8459-bf38-485f-971a-d8f1d7909898", "name": "network-vif-deleted", "tag": "5b00cee1-834c-4ff1-b027-9118ca362265"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:06:05.700969 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-c52d4ef5-6abe-440d-b819-7b0e1f51d1b9 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:05.701469 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-c52d4ef5-6abe-440d-b819-7b0e1f51d1b9 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] [instance: ff92db12-f23f-4be6-a091-217984a75150] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:05.703955 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-83bdafbd-5b28-443a-bc28-3a6330050029 req-dfee2c5f-147d-40cb-955f-7cfe9196e189 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:05.704614 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-83bdafbd-5b28-443a-bc28-3a6330050029 req-dfee2c5f-147d-40cb-955f-7cfe9196e189 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:05.718123 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-83bdafbd-5b28-443a-bc28-3a6330050029 req-dfee2c5f-147d-40cb-955f-7cfe9196e189 service nova] Creating event network-vif-deleted:5b00cee1-834c-4ff1-b027-9118ca362265 for instance 02de8459-bf38-485f-971a-d8f1d7909898 on hv-cinder-79760 Jun 03 10:06:05.724544 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-83bdafbd-5b28-443a-bc28-3a6330050029 req-dfee2c5f-147d-40cb-955f-7cfe9196e189 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033083 Jun 03 10:06:05.725950 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 562/1084] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:06:05.726366 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c52d4ef5-6abe-440d-b819-7b0e1f51d1b9 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:05.726702 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c52d4ef5-6abe-440d-b819-7b0e1f51d1b9 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:05.728093 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c52d4ef5-6abe-440d-b819-7b0e1f51d1b9 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:05.728834 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c52d4ef5-6abe-440d-b819-7b0e1f51d1b9 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:05.847715 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.objects.instance [None req-c52d4ef5-6abe-440d-b819-7b0e1f51d1b9 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lazy-loading 'services' on Instance uuid ff92db12-f23f-4be6-a091-217984a75150 {{(pid=117648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:06:05.941951 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-c52d4ef5-6abe-440d-b819-7b0e1f51d1b9 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] 10.222.0.45 "DELETE /compute/v2.1/servers/ff92db12-f23f-4be6-a091-217984a75150/os-volume_attachments/9147b8be-f3c1-4510-811b-9d6cd21da57d" status: 202 len: 0 microversion: 2.1 time: 0.244562 Jun 03 10:06:05.942961 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 523/1085] 10.222.0.45 () {58 vars in 1415 bytes} [Fri Jun 3 10:06:05 2022] DELETE /compute/v2.1/servers/ff92db12-f23f-4be6-a091-217984a75150/os-volume_attachments/9147b8be-f3c1-4510-811b-9d6cd21da57d => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 10:06:06.380545 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-ed337a5d-2550-41d8-94c0-dd633fc62c6a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:06.382641 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-ed337a5d-2550-41d8-94c0-dd633fc62c6a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:06.400263 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ed337a5d-2550-41d8-94c0-dd633fc62c6a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:06.401498 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ed337a5d-2550-41d8-94c0-dd633fc62c6a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:06.402563 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ed337a5d-2550-41d8-94c0-dd633fc62c6a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:06.403109 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ed337a5d-2550-41d8-94c0-dd633fc62c6a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:06.417836 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.wsgi [None req-ed337a5d-2550-41d8-94c0-dd633fc62c6a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] HTTP exception thrown: Instance 02de8459-bf38-485f-971a-d8f1d7909898 could not be found. Jun 03 10:06:06.419511 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-ed337a5d-2550-41d8-94c0-dd633fc62c6a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Request method failure captured: Jun 03 10:06:06.419511 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: request: GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 HTTP/1.1 Jun 03 10:06:06.419511 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Accept: application/json Jun 03 10:06:06.419511 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Accept-Encoding: identity Jun 03 10:06:06.419511 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Connection: close Jun 03 10:06:06.419511 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Content-Length: 0 Jun 03 10:06:06.419511 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Content-Type: application/json Jun 03 10:06:06.419511 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Host: 10.222.0.45 Jun 03 10:06:06.419511 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Openstack-System-Scope: None Jun 03 10:06:06.419511 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: User-Agent: python-urllib3/1.26.9 Jun 03 10:06:06.419511 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Auth-Token: gAAAAABimdrgYo-2Vx1ptXxuKskbsQP5xFp5LSYXxmUHaCucaaECgXqrofnYb6vFB0tvZ4-fuxC8WTFRs8zAaTayArTmZc193duu9m3yB5hBoanJOO16UmLM5QOPyhwq-HXhz7PJYHuC4UtHNwgnImpfgr-j4c0Y71voljIc6V56F_OoloPswpY Jun 03 10:06:06.419511 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Domain-Id: None Jun 03 10:06:06.419511 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Domain-Name: None Jun 03 10:06:06.419511 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Identity-Status: Confirmed Jun 03 10:06:06.419511 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Is-Admin-Project: True Jun 03 10:06:06.419511 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Openstack-Nova-Api-Version: 2.20 Jun 03 10:06:06.419511 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Domain-Id: default Jun 03 10:06:06.419511 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Domain-Name: Default Jun 03 10:06:06.419511 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Id: a937f473cd1b44bc8d628c7cadb18856 Jun 03 10:06:06.419511 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-656044302 Jun 03 10:06:06.419511 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Role: member,reader Jun 03 10:06:06.419511 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Roles: member,reader Jun 03 10:06:06.421034 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a937f473cd1b44bc8d628c7cadb18856", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a937f473cd1b44bc8d628c7cadb18856"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a937f473cd1b44bc8d628c7cadb18856"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a937f473cd1b44bc8d628c7cadb18856"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 10:06:06.421034 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant: tempest-AttachVolumeShelveTestJSON-656044302 Jun 03 10:06:06.421034 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant-Id: a937f473cd1b44bc8d628c7cadb18856 Jun 03 10:06:06.421034 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-656044302 Jun 03 10:06:06.421034 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User: tempest-AttachVolumeShelveTestJSON-656044302-project Jun 03 10:06:06.421034 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Domain-Id: default Jun 03 10:06:06.421034 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Domain-Name: Default Jun 03 10:06:06.421034 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Id: c216711b9e9b45f09f4917fe7b8275ab Jun 03 10:06:06.421034 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Name: tempest-AttachVolumeShelveTestJSON-656044302-project Jun 03 10:06:06.421034 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: method: > Jun 03 10:06:06.421034 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: exception: Instance 02de8459-bf38-485f-971a-d8f1d7909898 could not be found. Jun 03 10:06:06.421034 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: action_args: {'id': '02de8459-bf38-485f-971a-d8f1d7909898'} Jun 03 10:06:06.422712 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:06:06.422712 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:06:06.422712 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:06:06.422712 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:06:06.422712 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:06:06.422712 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:06:06.422712 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:06:06.422712 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:06:06.422712 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:06:06.422712 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:06:06.422712 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02de8459-bf38-485f-971a-d8f1d7909898 could not be found. Jun 03 10:06:06.422712 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:06:06.422712 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:06:06.422712 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:06:06.422712 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:06:06.422712 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:06:06.422712 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:06:06.422712 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:06:06.422712 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:06:06.422712 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:06:06.424157 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:06:06.424157 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:06:06.424157 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:06:06.424157 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:06:06.424157 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:06:06.424157 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:06:06.424157 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:06:06.424157 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02de8459-bf38-485f-971a-d8f1d7909898 could not be found. Jun 03 10:06:06.424157 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:06:06.424157 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:06:06.424157 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:06:06.424157 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:06:06.424157 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:06:06.424157 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:06:06.424157 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:06:06.424157 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:06:06.424157 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02de8459-bf38-485f-971a-d8f1d7909898 could not be found. Jun 03 10:06:06.424157 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:06:06.425425 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-ed337a5d-2550-41d8-94c0-dd633fc62c6a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Returning 404 to user: Instance 02de8459-bf38-485f-971a-d8f1d7909898 could not be found. {{(pid=117647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:06:06.425425 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-ed337a5d-2550-41d8-94c0-dd633fc62c6a tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 404 len: 111 microversion: 2.20 time: 0.047735 Jun 03 10:06:06.425425 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 563/1086] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:06:06 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 03 10:06:06.431095 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-835f643e-c820-43eb-a480-1acd729dd8c5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '.version_select at 0x7f5036cb8e50>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:06.451375 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-835f643e-c820-43eb-a480-1acd729dd8c5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1696527609" status: 204 len: 0 microversion: 2.20 time: 0.024325 Jun 03 10:06:06.454243 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 524/1087] 10.222.0.45 () {60 vars in 1261 bytes} [Fri Jun 3 10:06:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1696527609 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 03 10:06:07.641640 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-a6ff7912-5d13-4a8f-aad1-01a57baa5ed0 req-265baedb-e5ad-47f2-932c-df0f5e768a94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f81cb413-a285-476d-8b7a-62f99fd8fc31", "tag": "4a77bec9-e2d9-4e8b-8e47-96c23798d27d"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:06:07.654199 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-a6ff7912-5d13-4a8f-aad1-01a57baa5ed0 req-265baedb-e5ad-47f2-932c-df0f5e768a94 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:07.655059 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-a6ff7912-5d13-4a8f-aad1-01a57baa5ed0 req-265baedb-e5ad-47f2-932c-df0f5e768a94 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:07.684611 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-a6ff7912-5d13-4a8f-aad1-01a57baa5ed0 req-265baedb-e5ad-47f2-932c-df0f5e768a94 service nova] Creating event network-changed:4a77bec9-e2d9-4e8b-8e47-96c23798d27d for instance f81cb413-a285-476d-8b7a-62f99fd8fc31 on hv-cinder-79760 Jun 03 10:06:07.690305 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-a6ff7912-5d13-4a8f-aad1-01a57baa5ed0 req-265baedb-e5ad-47f2-932c-df0f5e768a94 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054495 Jun 03 10:06:07.691583 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 564/1088] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:06:08.143792 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-64fc55b5-77cd-4803-8f56-3c007ccc696f tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:08.146121 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-64fc55b5-77cd-4803-8f56-3c007ccc696f tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] [instance: ff92db12-f23f-4be6-a091-217984a75150] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:08.162008 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-64fc55b5-77cd-4803-8f56-3c007ccc696f tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:08.163007 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-64fc55b5-77cd-4803-8f56-3c007ccc696f tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:08.164883 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-64fc55b5-77cd-4803-8f56-3c007ccc696f tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:08.165602 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-64fc55b5-77cd-4803-8f56-3c007ccc696f tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:08.198777 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-64fc55b5-77cd-4803-8f56-3c007ccc696f tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] [instance: ff92db12-f23f-4be6-a091-217984a75150] Going to try to terminate instance {{(pid=117648) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 10:06:08.311010 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-64fc55b5-77cd-4803-8f56-3c007ccc696f tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] 10.222.0.45 "DELETE /compute/v2.1/servers/ff92db12-f23f-4be6-a091-217984a75150" status: 204 len: 0 microversion: 2.1 time: 0.171276 Jun 03 10:06:08.318657 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 525/1089] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jun 3 10:06:08 2022] DELETE /compute/v2.1/servers/ff92db12-f23f-4be6-a091-217984a75150 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 10:06:08.327860 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-4f01afb7-32ca-4072-9d2f-7a224bec5470 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:08.329044 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-4f01afb7-32ca-4072-9d2f-7a224bec5470 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] [instance: ff92db12-f23f-4be6-a091-217984a75150] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:08.344636 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4f01afb7-32ca-4072-9d2f-7a224bec5470 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:08.345582 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4f01afb7-32ca-4072-9d2f-7a224bec5470 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:08.348743 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4f01afb7-32ca-4072-9d2f-7a224bec5470 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:08.351250 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4f01afb7-32ca-4072-9d2f-7a224bec5470 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:08.353344 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-e3e3199c-facb-4c51-b1ea-d443d9f908f5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:08.353966 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-e3e3199c-facb-4c51-b1ea-d443d9f908f5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:08.360457 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e3e3199c-facb-4c51-b1ea-d443d9f908f5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:08.360910 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e3e3199c-facb-4c51-b1ea-d443d9f908f5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:08.361683 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e3e3199c-facb-4c51-b1ea-d443d9f908f5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:08.362145 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e3e3199c-facb-4c51-b1ea-d443d9f908f5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:08.380695 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.wsgi [None req-e3e3199c-facb-4c51-b1ea-d443d9f908f5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] HTTP exception thrown: Instance 02de8459-bf38-485f-971a-d8f1d7909898 could not be found. Jun 03 10:06:08.382599 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-e3e3199c-facb-4c51-b1ea-d443d9f908f5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Request method failure captured: Jun 03 10:06:08.382599 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: request: DELETE /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 HTTP/1.1 Jun 03 10:06:08.382599 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept: application/json Jun 03 10:06:08.382599 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept-Encoding: identity Jun 03 10:06:08.382599 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Connection: close Jun 03 10:06:08.382599 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Length: 0 Jun 03 10:06:08.382599 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Type: application/json Jun 03 10:06:08.382599 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Host: 10.222.0.45 Jun 03 10:06:08.382599 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Openstack-System-Scope: None Jun 03 10:06:08.382599 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: User-Agent: python-urllib3/1.26.9 Jun 03 10:06:08.382599 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Auth-Token: gAAAAABimdrgYo-2Vx1ptXxuKskbsQP5xFp5LSYXxmUHaCucaaECgXqrofnYb6vFB0tvZ4-fuxC8WTFRs8zAaTayArTmZc193duu9m3yB5hBoanJOO16UmLM5QOPyhwq-HXhz7PJYHuC4UtHNwgnImpfgr-j4c0Y71voljIc6V56F_OoloPswpY Jun 03 10:06:08.382599 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Id: None Jun 03 10:06:08.382599 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Name: None Jun 03 10:06:08.382599 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Identity-Status: Confirmed Jun 03 10:06:08.382599 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Is-Admin-Project: True Jun 03 10:06:08.382599 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Openstack-Nova-Api-Version: 2.20 Jun 03 10:06:08.382599 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Id: default Jun 03 10:06:08.382599 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Name: Default Jun 03 10:06:08.382599 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Id: a937f473cd1b44bc8d628c7cadb18856 Jun 03 10:06:08.382599 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-656044302 Jun 03 10:06:08.382599 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Role: member,reader Jun 03 10:06:08.382599 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Roles: member,reader Jun 03 10:06:08.384033 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a937f473cd1b44bc8d628c7cadb18856", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a937f473cd1b44bc8d628c7cadb18856"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a937f473cd1b44bc8d628c7cadb18856"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a937f473cd1b44bc8d628c7cadb18856"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 10:06:08.384033 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant: tempest-AttachVolumeShelveTestJSON-656044302 Jun 03 10:06:08.384033 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Id: a937f473cd1b44bc8d628c7cadb18856 Jun 03 10:06:08.384033 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-656044302 Jun 03 10:06:08.384033 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User: tempest-AttachVolumeShelveTestJSON-656044302-project Jun 03 10:06:08.384033 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Id: default Jun 03 10:06:08.384033 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Name: Default Jun 03 10:06:08.384033 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Id: c216711b9e9b45f09f4917fe7b8275ab Jun 03 10:06:08.384033 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Name: tempest-AttachVolumeShelveTestJSON-656044302-project Jun 03 10:06:08.384033 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: method: > Jun 03 10:06:08.384033 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: exception: Instance 02de8459-bf38-485f-971a-d8f1d7909898 could not be found. Jun 03 10:06:08.384033 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: action_args: {'id': '02de8459-bf38-485f-971a-d8f1d7909898'} Jun 03 10:06:08.384815 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:06:08.384815 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:06:08.384815 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:06:08.384815 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:06:08.384815 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:06:08.384815 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:06:08.384815 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:06:08.384815 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:06:08.384815 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:06:08.384815 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:06:08.384815 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02de8459-bf38-485f-971a-d8f1d7909898 could not be found. Jun 03 10:06:08.384815 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:06:08.384815 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:06:08.384815 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:06:08.384815 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:06:08.384815 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:06:08.384815 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:06:08.384815 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:06:08.384815 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:06:08.384815 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:06:08.386359 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:06:08.386359 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 10:06:08.386359 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 10:06:08.386359 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 10:06:08.386359 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 10:06:08.386359 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:06:08.386359 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:06:08.386359 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:06:08.386359 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:06:08.386359 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02de8459-bf38-485f-971a-d8f1d7909898 could not be found. Jun 03 10:06:08.386359 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:06:08.386359 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:06:08.386359 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:06:08.386359 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:06:08.386359 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:06:08.386359 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:06:08.386359 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:06:08.386359 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:06:08.386359 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02de8459-bf38-485f-971a-d8f1d7909898 could not be found. Jun 03 10:06:08.386359 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:06:08.388582 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-e3e3199c-facb-4c51-b1ea-d443d9f908f5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Returning 404 to user: Instance 02de8459-bf38-485f-971a-d8f1d7909898 could not be found. {{(pid=117648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:06:08.388582 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-e3e3199c-facb-4c51-b1ea-d443d9f908f5 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "DELETE /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 404 len: 111 microversion: 2.20 time: 0.034870 Jun 03 10:06:08.388582 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 526/1090] 10.222.0.45 () {60 vars in 1279 bytes} [Fri Jun 3 10:06:08 2022] DELETE /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 03 10:06:08.404274 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-18437f31-f3c1-4fd7-aec1-c207579c28b8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:08.404899 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-18437f31-f3c1-4fd7-aec1-c207579c28b8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 02de8459-bf38-485f-971a-d8f1d7909898] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:08.412691 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-18437f31-f3c1-4fd7-aec1-c207579c28b8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:08.413148 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-18437f31-f3c1-4fd7-aec1-c207579c28b8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:08.413964 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-18437f31-f3c1-4fd7-aec1-c207579c28b8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:08.414468 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-18437f31-f3c1-4fd7-aec1-c207579c28b8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:08.430116 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.wsgi [None req-18437f31-f3c1-4fd7-aec1-c207579c28b8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] HTTP exception thrown: Instance 02de8459-bf38-485f-971a-d8f1d7909898 could not be found. Jun 03 10:06:08.432191 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-18437f31-f3c1-4fd7-aec1-c207579c28b8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Request method failure captured: Jun 03 10:06:08.432191 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: request: GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 HTTP/1.1 Jun 03 10:06:08.432191 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept: application/json Jun 03 10:06:08.432191 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept-Encoding: identity Jun 03 10:06:08.432191 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Connection: close Jun 03 10:06:08.432191 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Length: 0 Jun 03 10:06:08.432191 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Type: application/json Jun 03 10:06:08.432191 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Host: 10.222.0.45 Jun 03 10:06:08.432191 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Openstack-System-Scope: None Jun 03 10:06:08.432191 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: User-Agent: python-urllib3/1.26.9 Jun 03 10:06:08.432191 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Auth-Token: gAAAAABimdrgYo-2Vx1ptXxuKskbsQP5xFp5LSYXxmUHaCucaaECgXqrofnYb6vFB0tvZ4-fuxC8WTFRs8zAaTayArTmZc193duu9m3yB5hBoanJOO16UmLM5QOPyhwq-HXhz7PJYHuC4UtHNwgnImpfgr-j4c0Y71voljIc6V56F_OoloPswpY Jun 03 10:06:08.432191 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Id: None Jun 03 10:06:08.432191 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Name: None Jun 03 10:06:08.432191 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Identity-Status: Confirmed Jun 03 10:06:08.432191 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Is-Admin-Project: True Jun 03 10:06:08.432191 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Openstack-Nova-Api-Version: 2.20 Jun 03 10:06:08.432191 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Id: default Jun 03 10:06:08.432191 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Name: Default Jun 03 10:06:08.432191 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Id: a937f473cd1b44bc8d628c7cadb18856 Jun 03 10:06:08.432191 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-656044302 Jun 03 10:06:08.432191 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Role: member,reader Jun 03 10:06:08.432191 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Roles: member,reader Jun 03 10:06:08.433671 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a937f473cd1b44bc8d628c7cadb18856", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a937f473cd1b44bc8d628c7cadb18856"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a937f473cd1b44bc8d628c7cadb18856"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a937f473cd1b44bc8d628c7cadb18856"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 10:06:08.433671 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant: tempest-AttachVolumeShelveTestJSON-656044302 Jun 03 10:06:08.433671 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Id: a937f473cd1b44bc8d628c7cadb18856 Jun 03 10:06:08.433671 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-656044302 Jun 03 10:06:08.433671 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User: tempest-AttachVolumeShelveTestJSON-656044302-project Jun 03 10:06:08.433671 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Id: default Jun 03 10:06:08.433671 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Name: Default Jun 03 10:06:08.433671 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Id: c216711b9e9b45f09f4917fe7b8275ab Jun 03 10:06:08.433671 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Name: tempest-AttachVolumeShelveTestJSON-656044302-project Jun 03 10:06:08.433671 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: method: > Jun 03 10:06:08.433671 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: exception: Instance 02de8459-bf38-485f-971a-d8f1d7909898 could not be found. Jun 03 10:06:08.433671 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: action_args: {'id': '02de8459-bf38-485f-971a-d8f1d7909898'} Jun 03 10:06:08.434453 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:06:08.434453 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:06:08.434453 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:06:08.434453 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:06:08.434453 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:06:08.434453 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:06:08.434453 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:06:08.434453 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:06:08.434453 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:06:08.434453 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:06:08.434453 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02de8459-bf38-485f-971a-d8f1d7909898 could not be found. Jun 03 10:06:08.434453 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:06:08.434453 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:06:08.434453 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:06:08.434453 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:06:08.434453 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:06:08.434453 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:06:08.434453 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:06:08.434453 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:06:08.434453 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:06:08.437539 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:06:08.437539 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:06:08.437539 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:06:08.437539 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:06:08.437539 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:06:08.437539 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:06:08.437539 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:06:08.437539 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02de8459-bf38-485f-971a-d8f1d7909898 could not be found. Jun 03 10:06:08.437539 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:06:08.437539 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:06:08.437539 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:06:08.437539 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:06:08.437539 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:06:08.437539 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:06:08.437539 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:06:08.437539 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:06:08.437539 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02de8459-bf38-485f-971a-d8f1d7909898 could not be found. Jun 03 10:06:08.437539 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:06:08.438915 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-18437f31-f3c1-4fd7-aec1-c207579c28b8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Returning 404 to user: Instance 02de8459-bf38-485f-971a-d8f1d7909898 could not be found. {{(pid=117648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:06:08.438915 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-18437f31-f3c1-4fd7-aec1-c207579c28b8 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898" status: 404 len: 111 microversion: 2.20 time: 0.044855 Jun 03 10:06:08.438915 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 527/1091] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:06:08 2022] GET /compute/v2.1/servers/02de8459-bf38-485f-971a-d8f1d7909898 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 03 10:06:08.537956 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-4f01afb7-32ca-4072-9d2f-7a224bec5470 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d75851094d145f4907c7049d78dafed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddc37afc4d54ccab945af619507a613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:08.550049 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-4f01afb7-32ca-4072-9d2f-7a224bec5470 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] 10.222.0.45 "GET /compute/v2.1/servers/ff92db12-f23f-4be6-a091-217984a75150" status: 200 len: 1513 microversion: 2.1 time: 0.228972 Jun 03 10:06:08.560922 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 565/1092] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:08 2022] GET /compute/v2.1/servers/ff92db12-f23f-4be6-a091-217984a75150 => generated 1513 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:09.568264 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-c5c48ccf-cba7-430a-aaf6-da03af90d97e tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:09.568916 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-c5c48ccf-cba7-430a-aaf6-da03af90d97e tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] [instance: ff92db12-f23f-4be6-a091-217984a75150] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:09.575706 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c5c48ccf-cba7-430a-aaf6-da03af90d97e tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:09.576182 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c5c48ccf-cba7-430a-aaf6-da03af90d97e tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:09.576957 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c5c48ccf-cba7-430a-aaf6-da03af90d97e tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:09.577412 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c5c48ccf-cba7-430a-aaf6-da03af90d97e tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:09.623155 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-9e42f9c9-c4d3-4e52-8483-f330de36d91e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:09.623671 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-9e42f9c9-c4d3-4e52-8483-f330de36d91e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:09.630916 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9e42f9c9-c4d3-4e52-8483-f330de36d91e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:09.631363 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9e42f9c9-c4d3-4e52-8483-f330de36d91e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:09.632146 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9e42f9c9-c4d3-4e52-8483-f330de36d91e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:09.632617 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9e42f9c9-c4d3-4e52-8483-f330de36d91e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:09.647263 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.wsgi [None req-9e42f9c9-c4d3-4e52-8483-f330de36d91e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] HTTP exception thrown: Instance 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f could not be found. Jun 03 10:06:09.649112 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-9e42f9c9-c4d3-4e52-8483-f330de36d91e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Request method failure captured: Jun 03 10:06:09.649112 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: request: DELETE /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f HTTP/1.1 Jun 03 10:06:09.649112 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Accept: application/json Jun 03 10:06:09.649112 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Accept-Encoding: identity Jun 03 10:06:09.649112 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Connection: close Jun 03 10:06:09.649112 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Content-Length: 0 Jun 03 10:06:09.649112 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Content-Type: application/json Jun 03 10:06:09.649112 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Host: 10.222.0.45 Jun 03 10:06:09.649112 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Openstack-System-Scope: None Jun 03 10:06:09.649112 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: User-Agent: python-urllib3/1.26.9 Jun 03 10:06:09.649112 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Auth-Token: gAAAAABimdrgYo-2Vx1ptXxuKskbsQP5xFp5LSYXxmUHaCucaaECgXqrofnYb6vFB0tvZ4-fuxC8WTFRs8zAaTayArTmZc193duu9m3yB5hBoanJOO16UmLM5QOPyhwq-HXhz7PJYHuC4UtHNwgnImpfgr-j4c0Y71voljIc6V56F_OoloPswpY Jun 03 10:06:09.649112 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Domain-Id: None Jun 03 10:06:09.649112 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Domain-Name: None Jun 03 10:06:09.649112 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Identity-Status: Confirmed Jun 03 10:06:09.649112 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Is-Admin-Project: True Jun 03 10:06:09.649112 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Openstack-Nova-Api-Version: 2.20 Jun 03 10:06:09.649112 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Domain-Id: default Jun 03 10:06:09.649112 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Domain-Name: Default Jun 03 10:06:09.649112 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Id: a937f473cd1b44bc8d628c7cadb18856 Jun 03 10:06:09.649112 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-656044302 Jun 03 10:06:09.649112 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Role: member,reader Jun 03 10:06:09.649112 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Roles: member,reader Jun 03 10:06:09.650641 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a937f473cd1b44bc8d628c7cadb18856", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a937f473cd1b44bc8d628c7cadb18856"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a937f473cd1b44bc8d628c7cadb18856"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a937f473cd1b44bc8d628c7cadb18856"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 10:06:09.650641 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant: tempest-AttachVolumeShelveTestJSON-656044302 Jun 03 10:06:09.650641 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant-Id: a937f473cd1b44bc8d628c7cadb18856 Jun 03 10:06:09.650641 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-656044302 Jun 03 10:06:09.650641 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User: tempest-AttachVolumeShelveTestJSON-656044302-project Jun 03 10:06:09.650641 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Domain-Id: default Jun 03 10:06:09.650641 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Domain-Name: Default Jun 03 10:06:09.650641 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Id: c216711b9e9b45f09f4917fe7b8275ab Jun 03 10:06:09.650641 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Name: tempest-AttachVolumeShelveTestJSON-656044302-project Jun 03 10:06:09.650641 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: method: > Jun 03 10:06:09.650641 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: exception: Instance 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f could not be found. Jun 03 10:06:09.650641 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: action_args: {'id': '5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f'} Jun 03 10:06:09.651412 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:06:09.651412 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:06:09.651412 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:06:09.651412 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:06:09.651412 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:06:09.651412 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:06:09.651412 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:06:09.651412 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:06:09.651412 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:06:09.651412 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:06:09.651412 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f could not be found. Jun 03 10:06:09.651412 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:06:09.651412 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:06:09.651412 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:06:09.651412 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:06:09.651412 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:06:09.651412 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:06:09.651412 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:06:09.651412 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:06:09.651412 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:06:09.652652 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:06:09.652652 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 10:06:09.652652 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 10:06:09.652652 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 10:06:09.652652 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 10:06:09.652652 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:06:09.652652 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:06:09.652652 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:06:09.652652 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:06:09.652652 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f could not be found. Jun 03 10:06:09.652652 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:06:09.652652 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:06:09.652652 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:06:09.652652 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:06:09.652652 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:06:09.652652 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:06:09.652652 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:06:09.652652 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:06:09.652652 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f could not be found. Jun 03 10:06:09.652652 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:06:09.653915 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-9e42f9c9-c4d3-4e52-8483-f330de36d91e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Returning 404 to user: Instance 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f could not be found. {{(pid=117647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:06:09.653915 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-9e42f9c9-c4d3-4e52-8483-f330de36d91e tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "DELETE /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 404 len: 111 microversion: 2.20 time: 0.039472 Jun 03 10:06:09.653915 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 566/1093] 10.222.0.45 () {60 vars in 1279 bytes} [Fri Jun 3 10:06:09 2022] DELETE /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 03 10:06:09.659047 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-808b0e0f-d3e8-499a-8a8b-e596d5791098 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:09.659670 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-808b0e0f-d3e8-499a-8a8b-e596d5791098 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] [instance: 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:09.666028 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-808b0e0f-d3e8-499a-8a8b-e596d5791098 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:09.666399 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-808b0e0f-d3e8-499a-8a8b-e596d5791098 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:09.667179 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-808b0e0f-d3e8-499a-8a8b-e596d5791098 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:09.667621 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-808b0e0f-d3e8-499a-8a8b-e596d5791098 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:09.682024 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.wsgi [None req-808b0e0f-d3e8-499a-8a8b-e596d5791098 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] HTTP exception thrown: Instance 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f could not be found. Jun 03 10:06:09.683636 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-808b0e0f-d3e8-499a-8a8b-e596d5791098 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Request method failure captured: Jun 03 10:06:09.683636 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: request: GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f HTTP/1.1 Jun 03 10:06:09.683636 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Accept: application/json Jun 03 10:06:09.683636 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Accept-Encoding: identity Jun 03 10:06:09.683636 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Connection: close Jun 03 10:06:09.683636 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Content-Length: 0 Jun 03 10:06:09.683636 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Content-Type: application/json Jun 03 10:06:09.683636 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Host: 10.222.0.45 Jun 03 10:06:09.683636 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Openstack-System-Scope: None Jun 03 10:06:09.683636 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: User-Agent: python-urllib3/1.26.9 Jun 03 10:06:09.683636 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Auth-Token: gAAAAABimdrgYo-2Vx1ptXxuKskbsQP5xFp5LSYXxmUHaCucaaECgXqrofnYb6vFB0tvZ4-fuxC8WTFRs8zAaTayArTmZc193duu9m3yB5hBoanJOO16UmLM5QOPyhwq-HXhz7PJYHuC4UtHNwgnImpfgr-j4c0Y71voljIc6V56F_OoloPswpY Jun 03 10:06:09.683636 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Domain-Id: None Jun 03 10:06:09.683636 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Domain-Name: None Jun 03 10:06:09.683636 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Identity-Status: Confirmed Jun 03 10:06:09.683636 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Is-Admin-Project: True Jun 03 10:06:09.683636 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Openstack-Nova-Api-Version: 2.20 Jun 03 10:06:09.683636 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Domain-Id: default Jun 03 10:06:09.683636 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Domain-Name: Default Jun 03 10:06:09.683636 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Id: a937f473cd1b44bc8d628c7cadb18856 Jun 03 10:06:09.683636 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-656044302 Jun 03 10:06:09.683636 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Role: member,reader Jun 03 10:06:09.683636 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Roles: member,reader Jun 03 10:06:09.685057 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_a937f473cd1b44bc8d628c7cadb18856", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/a937f473cd1b44bc8d628c7cadb18856"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a937f473cd1b44bc8d628c7cadb18856"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/a937f473cd1b44bc8d628c7cadb18856"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 10:06:09.685057 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant: tempest-AttachVolumeShelveTestJSON-656044302 Jun 03 10:06:09.685057 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant-Id: a937f473cd1b44bc8d628c7cadb18856 Jun 03 10:06:09.685057 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-656044302 Jun 03 10:06:09.685057 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User: tempest-AttachVolumeShelveTestJSON-656044302-project Jun 03 10:06:09.685057 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Domain-Id: default Jun 03 10:06:09.685057 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Domain-Name: Default Jun 03 10:06:09.685057 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Id: c216711b9e9b45f09f4917fe7b8275ab Jun 03 10:06:09.685057 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Name: tempest-AttachVolumeShelveTestJSON-656044302-project Jun 03 10:06:09.685057 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: method: > Jun 03 10:06:09.685057 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: exception: Instance 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f could not be found. Jun 03 10:06:09.685057 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: action_args: {'id': '5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f'} Jun 03 10:06:09.685843 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:06:09.685843 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:06:09.685843 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:06:09.685843 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:06:09.685843 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:06:09.685843 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:06:09.685843 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:06:09.685843 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:06:09.685843 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:06:09.685843 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:06:09.685843 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f could not be found. Jun 03 10:06:09.685843 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:06:09.685843 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:06:09.685843 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:06:09.685843 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:06:09.685843 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:06:09.685843 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:06:09.685843 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:06:09.685843 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:06:09.685843 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:06:09.687113 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:06:09.687113 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:06:09.687113 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:06:09.687113 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:06:09.687113 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:06:09.687113 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:06:09.687113 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:06:09.687113 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f could not be found. Jun 03 10:06:09.687113 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:06:09.687113 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:06:09.687113 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:06:09.687113 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:06:09.687113 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:06:09.687113 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:06:09.687113 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:06:09.687113 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:06:09.687113 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f could not be found. Jun 03 10:06:09.687113 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:06:09.688310 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-808b0e0f-d3e8-499a-8a8b-e596d5791098 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] Returning 404 to user: Instance 5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f could not be found. {{(pid=117647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:06:09.688310 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-808b0e0f-d3e8-499a-8a8b-e596d5791098 tempest-AttachVolumeShelveTestJSON-656044302 tempest-AttachVolumeShelveTestJSON-656044302-project] 10.222.0.45 "GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f" status: 404 len: 111 microversion: 2.20 time: 0.029696 Jun 03 10:06:09.689491 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 567/1094] 10.222.0.45 () {60 vars in 1276 bytes} [Fri Jun 3 10:06:09 2022] GET /compute/v2.1/servers/5dd0d2cf-bf58-4bb0-8cf2-ca9e564ffe3f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 03 10:06:09.728219 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-c5c48ccf-cba7-430a-aaf6-da03af90d97e tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d75851094d145f4907c7049d78dafed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddc37afc4d54ccab945af619507a613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:09.736444 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-c5c48ccf-cba7-430a-aaf6-da03af90d97e tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] 10.222.0.45 "GET /compute/v2.1/servers/ff92db12-f23f-4be6-a091-217984a75150" status: 200 len: 1513 microversion: 2.1 time: 0.172422 Jun 03 10:06:09.737240 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 528/1095] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:09 2022] GET /compute/v2.1/servers/ff92db12-f23f-4be6-a091-217984a75150 => generated 1513 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:10.757101 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-f2adb18e-0d3b-4b8a-a90b-83191947b792 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:10.757698 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-f2adb18e-0d3b-4b8a-a90b-83191947b792 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] [instance: ff92db12-f23f-4be6-a091-217984a75150] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:10.766479 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f2adb18e-0d3b-4b8a-a90b-83191947b792 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:10.766920 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f2adb18e-0d3b-4b8a-a90b-83191947b792 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:10.767695 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f2adb18e-0d3b-4b8a-a90b-83191947b792 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:10.768126 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f2adb18e-0d3b-4b8a-a90b-83191947b792 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:10.962003 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-f2adb18e-0d3b-4b8a-a90b-83191947b792 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d75851094d145f4907c7049d78dafed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddc37afc4d54ccab945af619507a613', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:10.969804 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-f2adb18e-0d3b-4b8a-a90b-83191947b792 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] 10.222.0.45 "GET /compute/v2.1/servers/ff92db12-f23f-4be6-a091-217984a75150" status: 200 len: 1513 microversion: 2.1 time: 0.219579 Jun 03 10:06:10.970809 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 568/1096] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:10 2022] GET /compute/v2.1/servers/ff92db12-f23f-4be6-a091-217984a75150 => generated 1513 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:11.329237 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-9d5623f1-f08d-42b3-a361-31014d3b2ab5 req-c589b659-128d-402a-85fc-7fc9143acf56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff92db12-f23f-4be6-a091-217984a75150", "name": "network-vif-deleted", "tag": "bbb54229-7afa-4f45-b103-0476a9389d56"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:06:11.337987 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-9d5623f1-f08d-42b3-a361-31014d3b2ab5 req-c589b659-128d-402a-85fc-7fc9143acf56 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:11.338700 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-9d5623f1-f08d-42b3-a361-31014d3b2ab5 req-c589b659-128d-402a-85fc-7fc9143acf56 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:11.351214 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-9d5623f1-f08d-42b3-a361-31014d3b2ab5 req-c589b659-128d-402a-85fc-7fc9143acf56 service nova] Creating event network-vif-deleted:bbb54229-7afa-4f45-b103-0476a9389d56 for instance ff92db12-f23f-4be6-a091-217984a75150 on hv-cinder-79760 Jun 03 10:06:11.356079 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-9d5623f1-f08d-42b3-a361-31014d3b2ab5 req-c589b659-128d-402a-85fc-7fc9143acf56 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030437 Jun 03 10:06:11.356679 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 529/1097] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:06:11.987550 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-b65483a6-34bd-4267-b02f-39dd589a8252 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:11.988177 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-b65483a6-34bd-4267-b02f-39dd589a8252 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] [instance: ff92db12-f23f-4be6-a091-217984a75150] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:11.995549 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b65483a6-34bd-4267-b02f-39dd589a8252 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:11.996206 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b65483a6-34bd-4267-b02f-39dd589a8252 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:11.997835 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b65483a6-34bd-4267-b02f-39dd589a8252 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:11.998778 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b65483a6-34bd-4267-b02f-39dd589a8252 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:12.018663 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.wsgi [None req-b65483a6-34bd-4267-b02f-39dd589a8252 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] HTTP exception thrown: Instance ff92db12-f23f-4be6-a091-217984a75150 could not be found. Jun 03 10:06:12.020765 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-b65483a6-34bd-4267-b02f-39dd589a8252 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Request method failure captured: Jun 03 10:06:12.020765 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: request: GET /compute/v2.1/servers/ff92db12-f23f-4be6-a091-217984a75150 HTTP/1.1 Jun 03 10:06:12.020765 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Accept: application/json Jun 03 10:06:12.020765 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Accept-Encoding: identity Jun 03 10:06:12.020765 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Connection: close Jun 03 10:06:12.020765 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Content-Length: 0 Jun 03 10:06:12.020765 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Content-Type: application/json Jun 03 10:06:12.020765 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Host: 10.222.0.45 Jun 03 10:06:12.020765 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Openstack-System-Scope: None Jun 03 10:06:12.020765 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: User-Agent: python-urllib3/1.26.9 Jun 03 10:06:12.020765 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Auth-Token: gAAAAABimdyYT10lYqGF5PLo9GM611qeG6qxzBwmOGYqBLfLKtrln6PR0AwFCDrYQgMpuK744L9r_8ZLlSldKCP-NeBQ8ql7UpKbbSfjA5vCWZCPJMMABo94WTLuUVO-fm0NmHv5YdtJ02GwL1ggrwrtKdZ8qGJsC2JZfdJFWD6QgeW_nnHw9pY Jun 03 10:06:12.020765 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Domain-Id: None Jun 03 10:06:12.020765 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Domain-Name: None Jun 03 10:06:12.020765 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Identity-Status: Confirmed Jun 03 10:06:12.020765 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Is-Admin-Project: True Jun 03 10:06:12.020765 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Domain-Id: default Jun 03 10:06:12.020765 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Domain-Name: Default Jun 03 10:06:12.020765 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Id: 0ddc37afc4d54ccab945af619507a613 Jun 03 10:06:12.020765 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2049340705 Jun 03 10:06:12.020765 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Role: member,reader Jun 03 10:06:12.020765 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Roles: member,reader Jun 03 10:06:12.022506 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0ddc37afc4d54ccab945af619507a613", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0ddc37afc4d54ccab945af619507a613"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0ddc37afc4d54ccab945af619507a613"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0ddc37afc4d54ccab945af619507a613"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 10:06:12.022506 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant: tempest-VolumesSnapshotTestJSON-2049340705 Jun 03 10:06:12.022506 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant-Id: 0ddc37afc4d54ccab945af619507a613 Jun 03 10:06:12.022506 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2049340705 Jun 03 10:06:12.022506 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User: tempest-VolumesSnapshotTestJSON-2049340705-project Jun 03 10:06:12.022506 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Domain-Id: default Jun 03 10:06:12.022506 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Domain-Name: Default Jun 03 10:06:12.022506 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Id: 1d75851094d145f4907c7049d78dafed Jun 03 10:06:12.022506 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Name: tempest-VolumesSnapshotTestJSON-2049340705-project Jun 03 10:06:12.022506 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: method: > Jun 03 10:06:12.022506 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: exception: Instance ff92db12-f23f-4be6-a091-217984a75150 could not be found. Jun 03 10:06:12.022506 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: action_args: {'id': 'ff92db12-f23f-4be6-a091-217984a75150'} Jun 03 10:06:12.023363 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:06:12.023363 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:06:12.023363 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:06:12.023363 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:06:12.023363 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:06:12.023363 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:06:12.023363 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:06:12.023363 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:06:12.023363 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:06:12.023363 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:06:12.023363 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff92db12-f23f-4be6-a091-217984a75150 could not be found. Jun 03 10:06:12.023363 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:06:12.023363 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:06:12.023363 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:06:12.023363 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:06:12.023363 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:06:12.023363 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:06:12.023363 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:06:12.023363 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:06:12.023363 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:06:12.024694 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:06:12.024694 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:06:12.024694 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:06:12.024694 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:06:12.024694 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:06:12.024694 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:06:12.024694 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:06:12.024694 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff92db12-f23f-4be6-a091-217984a75150 could not be found. Jun 03 10:06:12.024694 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:06:12.024694 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:06:12.024694 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:06:12.024694 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:06:12.024694 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:06:12.024694 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:06:12.024694 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:06:12.024694 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:06:12.024694 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff92db12-f23f-4be6-a091-217984a75150 could not be found. Jun 03 10:06:12.024694 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:06:12.025958 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-b65483a6-34bd-4267-b02f-39dd589a8252 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] Returning 404 to user: Instance ff92db12-f23f-4be6-a091-217984a75150 could not be found. {{(pid=117647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:06:12.025958 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-b65483a6-34bd-4267-b02f-39dd589a8252 tempest-VolumesSnapshotTestJSON-2049340705 tempest-VolumesSnapshotTestJSON-2049340705-project] 10.222.0.45 "GET /compute/v2.1/servers/ff92db12-f23f-4be6-a091-217984a75150" status: 404 len: 111 microversion: 2.1 time: 0.038628 Jun 03 10:06:12.025958 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 569/1098] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:11 2022] GET /compute/v2.1/servers/ff92db12-f23f-4be6-a091-217984a75150 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 10:06:20.359359 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-d58bed47-4881-4c8f-9491-26143e9fed2f tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Action: 'create', calling method: .version_select at 0x7f5036dadf70>, body: {"keypair": {"name": "tempest-keypair-1823751609", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMNjt+CGMk6Eg8NMolGMtLFzGhRTjOhByE1henavBMWF7N9zNRmgAgV17Fe7mAe5uwIUm8Z+LVcD0mnOWDoljlSi1ggykZ5b0HrHeItwV5oNJjpnNAG/CYdU37FibVkc0Q=="}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:06:20.364089 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:06:20.383178 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-d58bed47-4881-4c8f-9491-26143e9fed2f tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Getting quotas for project 02a9ee05c1ee47e08b2f7c1601dda3c2. Resources: {'key_pairs'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 10:06:20.388268 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-d58bed47-4881-4c8f-9491-26143e9fed2f tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Getting quotas for user 617a19a03f4941dd98022cf3f8397fef and project 02a9ee05c1ee47e08b2f7c1601dda3c2. Resources: {'key_pairs'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 10:06:20.416988 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-d58bed47-4881-4c8f-9491-26143e9fed2f tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.231687 Jun 03 10:06:20.418888 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 530/1099] 10.222.0.45 () {60 vars in 1158 bytes} [Fri Jun 3 10:06:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:06:21.760800 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-a51ea698-56d1-46f3-8147-5bd12905b36b tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-231619942", "imageRef": "0cb3b007-4e95-448b-8acb-895d8acdb244", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5805b222-7daa-4d0b-86d7-cd458608951c"}], "security_groups": [{"name": "tempest-securitygroup--1706269028"}], "key_name": "tempest-keypair-1823751609", "user_data": "}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:06:21.767959 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:06:21.864964 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.network.neutron [None req-a51ea698-56d1-46f3-8147-5bd12905b36b tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] validate_networks() for [('5805b222-7daa-4d0b-86d7-cd458608951c', None, None, None, None, None)] {{(pid=117647) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 10:06:22.006437 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=64,nova_cell1:INSERT=1 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:06:22.251654 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-a51ea698-56d1-46f3-8147-5bd12905b36b tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Flavor limits 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 10:06:22.252388 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-a51ea698-56d1-46f3-8147-5bd12905b36b tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Image limits 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 10:06:22.252866 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-a51ea698-56d1-46f3-8147-5bd12905b36b tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Flavor pref 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 10:06:22.253277 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-a51ea698-56d1-46f3-8147-5bd12905b36b tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Image pref 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 10:06:22.254326 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-a51ea698-56d1-46f3-8147-5bd12905b36b tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 10:06:22.265901 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a51ea698-56d1-46f3-8147-5bd12905b36b tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:22.266411 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a51ea698-56d1-46f3-8147-5bd12905b36b tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:22.267220 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a51ea698-56d1-46f3-8147-5bd12905b36b tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:22.267655 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a51ea698-56d1-46f3-8147-5bd12905b36b tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:22.288812 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-a51ea698-56d1-46f3-8147-5bd12905b36b tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Getting quotas for project 02a9ee05c1ee47e08b2f7c1601dda3c2. Resources: {'ram', 'cores', 'instances'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 10:06:22.293317 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-a51ea698-56d1-46f3-8147-5bd12905b36b tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Getting quotas for user 617a19a03f4941dd98022cf3f8397fef and project 02a9ee05c1ee47e08b2f7c1601dda3c2. Resources: {'ram', 'cores', 'instances'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 10:06:22.305510 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-a51ea698-56d1-46f3-8147-5bd12905b36b tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Going to run 1 instances... {{(pid=117647) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 10:06:22.307957 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-a51ea698-56d1-46f3-8147-5bd12905b36b tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: c5e57f45-cd85-4221-a195-5abaec163b5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0cb3b007-4e95-448b-8acb-895d8acdb244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 10:06:22.358541 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-a51ea698-56d1-46f3-8147-5bd12905b36b tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.601932 Jun 03 10:06:22.359455 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 570/1100] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jun 3 10:06:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 10:06:22.369470 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-dfc17127-4229-4900-b281-095ea9bc7930 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:22.370268 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-dfc17127-4229-4900-b281-095ea9bc7930 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: c5e57f45-cd85-4221-a195-5abaec163b5a] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:22.372688 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:06:22.452536 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-dfc17127-4229-4900-b281-095ea9bc7930 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617a19a03f4941dd98022cf3f8397fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:22.461335 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-dfc17127-4229-4900-b281-095ea9bc7930 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a" status: 200 len: 1237 microversion: 2.1 time: 0.095553 Jun 03 10:06:22.461947 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 531/1101] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:22 2022] GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a => generated 1237 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:23.479783 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-8885e658-aa76-4eab-a888-3c5677cbd6d2 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:23.481390 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-8885e658-aa76-4eab-a888-3c5677cbd6d2 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: c5e57f45-cd85-4221-a195-5abaec163b5a] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:23.491109 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8885e658-aa76-4eab-a888-3c5677cbd6d2 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:23.491562 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8885e658-aa76-4eab-a888-3c5677cbd6d2 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:23.492355 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8885e658-aa76-4eab-a888-3c5677cbd6d2 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:23.493452 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8885e658-aa76-4eab-a888-3c5677cbd6d2 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:23.576085 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-8885e658-aa76-4eab-a888-3c5677cbd6d2 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617a19a03f4941dd98022cf3f8397fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:23.584640 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-8885e658-aa76-4eab-a888-3c5677cbd6d2 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a" status: 200 len: 1233 microversion: 2.1 time: 0.109372 Jun 03 10:06:23.585464 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 571/1102] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:23 2022] GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a => generated 1233 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:24.602779 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-69245ef3-29d6-4a2b-8fb3-cd88adb35ac7 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:24.603660 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-69245ef3-29d6-4a2b-8fb3-cd88adb35ac7 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: c5e57f45-cd85-4221-a195-5abaec163b5a] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:24.611226 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-69245ef3-29d6-4a2b-8fb3-cd88adb35ac7 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:24.611783 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-69245ef3-29d6-4a2b-8fb3-cd88adb35ac7 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:24.612659 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-69245ef3-29d6-4a2b-8fb3-cd88adb35ac7 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:24.613544 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-69245ef3-29d6-4a2b-8fb3-cd88adb35ac7 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:24.684354 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-69245ef3-29d6-4a2b-8fb3-cd88adb35ac7 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617a19a03f4941dd98022cf3f8397fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:24.695245 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-69245ef3-29d6-4a2b-8fb3-cd88adb35ac7 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a" status: 200 len: 1295 microversion: 2.1 time: 0.096603 Jun 03 10:06:24.696033 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 532/1103] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:24 2022] GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a => generated 1295 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:25.713528 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-06553726-7524-4c89-b0ac-0295eb9c0571 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:25.714171 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-06553726-7524-4c89-b0ac-0295eb9c0571 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: c5e57f45-cd85-4221-a195-5abaec163b5a] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:25.721025 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-06553726-7524-4c89-b0ac-0295eb9c0571 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:25.721392 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-06553726-7524-4c89-b0ac-0295eb9c0571 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:25.723856 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-06553726-7524-4c89-b0ac-0295eb9c0571 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:25.724754 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-06553726-7524-4c89-b0ac-0295eb9c0571 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:25.773836 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-79edfde4-b195-4c5a-83b4-907324c480cd req-4736133a-9088-48e8-bdbc-52071fffa0d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5e57f45-cd85-4221-a195-5abaec163b5a", "tag": "d8504749-9ecd-4d58-8b48-705f58c8ba6c"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:06:25.782577 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-79edfde4-b195-4c5a-83b4-907324c480cd req-4736133a-9088-48e8-bdbc-52071fffa0d3 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:25.783210 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-79edfde4-b195-4c5a-83b4-907324c480cd req-4736133a-9088-48e8-bdbc-52071fffa0d3 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:25.795261 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-79edfde4-b195-4c5a-83b4-907324c480cd req-4736133a-9088-48e8-bdbc-52071fffa0d3 service nova] Creating event network-changed:d8504749-9ecd-4d58-8b48-705f58c8ba6c for instance c5e57f45-cd85-4221-a195-5abaec163b5a on hv-cinder-79760 Jun 03 10:06:25.800000 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-79edfde4-b195-4c5a-83b4-907324c480cd req-4736133a-9088-48e8-bdbc-52071fffa0d3 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030473 Jun 03 10:06:25.801126 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 533/1104] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:06:25.895621 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-06553726-7524-4c89-b0ac-0295eb9c0571 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617a19a03f4941dd98022cf3f8397fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:25.903411 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-06553726-7524-4c89-b0ac-0295eb9c0571 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a" status: 200 len: 1363 microversion: 2.1 time: 0.194246 Jun 03 10:06:25.903994 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 572/1105] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:25 2022] GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:26.921298 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-089e94ac-c323-4de4-a76f-b64b85b5d544 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:26.921983 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-089e94ac-c323-4de4-a76f-b64b85b5d544 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: c5e57f45-cd85-4221-a195-5abaec163b5a] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:26.928783 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-089e94ac-c323-4de4-a76f-b64b85b5d544 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:26.929225 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-089e94ac-c323-4de4-a76f-b64b85b5d544 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:26.930008 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-089e94ac-c323-4de4-a76f-b64b85b5d544 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:26.930441 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-089e94ac-c323-4de4-a76f-b64b85b5d544 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:27.061956 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-089e94ac-c323-4de4-a76f-b64b85b5d544 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617a19a03f4941dd98022cf3f8397fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:27.069470 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-089e94ac-c323-4de4-a76f-b64b85b5d544 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a" status: 200 len: 1363 microversion: 2.1 time: 0.152890 Jun 03 10:06:27.070054 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 534/1106] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:26 2022] GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:28.086233 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-9862956a-e1b2-4f90-a8d4-94b45fed0697 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:28.086841 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-9862956a-e1b2-4f90-a8d4-94b45fed0697 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: c5e57f45-cd85-4221-a195-5abaec163b5a] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:28.093270 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9862956a-e1b2-4f90-a8d4-94b45fed0697 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:28.093718 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9862956a-e1b2-4f90-a8d4-94b45fed0697 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:28.094507 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9862956a-e1b2-4f90-a8d4-94b45fed0697 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:28.094942 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9862956a-e1b2-4f90-a8d4-94b45fed0697 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:28.228899 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-9862956a-e1b2-4f90-a8d4-94b45fed0697 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617a19a03f4941dd98022cf3f8397fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:28.236693 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-9862956a-e1b2-4f90-a8d4-94b45fed0697 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a" status: 200 len: 1363 microversion: 2.1 time: 0.154549 Jun 03 10:06:28.237252 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 573/1107] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:28 2022] GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:29.254746 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-274a8c10-e9c6-4d7c-85a0-f19f31beeb1b tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:29.255364 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-274a8c10-e9c6-4d7c-85a0-f19f31beeb1b tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: c5e57f45-cd85-4221-a195-5abaec163b5a] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:29.262099 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-274a8c10-e9c6-4d7c-85a0-f19f31beeb1b tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:29.262545 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-274a8c10-e9c6-4d7c-85a0-f19f31beeb1b tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:29.263301 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-274a8c10-e9c6-4d7c-85a0-f19f31beeb1b tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:29.263736 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-274a8c10-e9c6-4d7c-85a0-f19f31beeb1b tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:29.397320 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-274a8c10-e9c6-4d7c-85a0-f19f31beeb1b tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617a19a03f4941dd98022cf3f8397fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:29.404802 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-274a8c10-e9c6-4d7c-85a0-f19f31beeb1b tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a" status: 200 len: 1363 microversion: 2.1 time: 0.154475 Jun 03 10:06:29.405362 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 535/1108] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:29 2022] GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:30.422042 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-cd9f0469-b478-44f9-99ba-6dc52d8d31bf tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:30.422654 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-cd9f0469-b478-44f9-99ba-6dc52d8d31bf tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: c5e57f45-cd85-4221-a195-5abaec163b5a] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:30.429588 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cd9f0469-b478-44f9-99ba-6dc52d8d31bf tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:30.430046 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cd9f0469-b478-44f9-99ba-6dc52d8d31bf tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:30.430894 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cd9f0469-b478-44f9-99ba-6dc52d8d31bf tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:30.431505 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-cd9f0469-b478-44f9-99ba-6dc52d8d31bf tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:30.579665 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-cd9f0469-b478-44f9-99ba-6dc52d8d31bf tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617a19a03f4941dd98022cf3f8397fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:30.587718 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-cd9f0469-b478-44f9-99ba-6dc52d8d31bf tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a" status: 200 len: 1363 microversion: 2.1 time: 0.169445 Jun 03 10:06:30.588375 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 574/1109] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:30 2022] GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:31.606013 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-e2be4558-9a13-47a4-a2cd-968eb39245e6 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:31.606630 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-e2be4558-9a13-47a4-a2cd-968eb39245e6 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: c5e57f45-cd85-4221-a195-5abaec163b5a] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:31.614793 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e2be4558-9a13-47a4-a2cd-968eb39245e6 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:31.615278 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e2be4558-9a13-47a4-a2cd-968eb39245e6 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:31.616058 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e2be4558-9a13-47a4-a2cd-968eb39245e6 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:31.616495 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e2be4558-9a13-47a4-a2cd-968eb39245e6 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:31.755585 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-e2be4558-9a13-47a4-a2cd-968eb39245e6 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617a19a03f4941dd98022cf3f8397fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:31.763816 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-e2be4558-9a13-47a4-a2cd-968eb39245e6 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a" status: 200 len: 1363 microversion: 2.1 time: 0.162361 Jun 03 10:06:31.764496 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 536/1110] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:31 2022] GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:31.777153 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-d7138f28-88c6-4c9c-9a6d-39fc4cebed31 req-1e80bc5e-121d-45c1-98fe-743280c9c99a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5e57f45-cd85-4221-a195-5abaec163b5a", "name": "network-vif-plugged", "status": "completed", "tag": "d8504749-9ecd-4d58-8b48-705f58c8ba6c"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:06:31.786741 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-d7138f28-88c6-4c9c-9a6d-39fc4cebed31 req-1e80bc5e-121d-45c1-98fe-743280c9c99a service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:31.788037 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-d7138f28-88c6-4c9c-9a6d-39fc4cebed31 req-1e80bc5e-121d-45c1-98fe-743280c9c99a service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:31.799309 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-d7138f28-88c6-4c9c-9a6d-39fc4cebed31 req-1e80bc5e-121d-45c1-98fe-743280c9c99a service nova] Creating event network-vif-plugged:d8504749-9ecd-4d58-8b48-705f58c8ba6c for instance c5e57f45-cd85-4221-a195-5abaec163b5a on hv-cinder-79760 Jun 03 10:06:31.804330 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-d7138f28-88c6-4c9c-9a6d-39fc4cebed31 req-1e80bc5e-121d-45c1-98fe-743280c9c99a service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034435 Jun 03 10:06:31.805526 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 575/1111] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:06:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:06:32.780724 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-f2452c2a-10fb-4a76-b643-da28ded85a13 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:32.781459 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-f2452c2a-10fb-4a76-b643-da28ded85a13 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: c5e57f45-cd85-4221-a195-5abaec163b5a] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:32.783486 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell0:SELECT=6 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:06:32.789926 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f2452c2a-10fb-4a76-b643-da28ded85a13 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:32.790376 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f2452c2a-10fb-4a76-b643-da28ded85a13 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:32.791136 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f2452c2a-10fb-4a76-b643-da28ded85a13 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:32.791573 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f2452c2a-10fb-4a76-b643-da28ded85a13 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:32.921205 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f2452c2a-10fb-4a76-b643-da28ded85a13 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617a19a03f4941dd98022cf3f8397fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:32.929554 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-f2452c2a-10fb-4a76-b643-da28ded85a13 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a" status: 200 len: 1363 microversion: 2.1 time: 0.152739 Jun 03 10:06:32.930164 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 537/1112] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:32 2022] GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:33.947233 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-61389be9-2127-4d2c-b272-f7d990069f19 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:33.947939 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-61389be9-2127-4d2c-b272-f7d990069f19 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: c5e57f45-cd85-4221-a195-5abaec163b5a] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:33.949951 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell0:SELECT=2 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:06:33.950701 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell0:SELECT=6 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:06:33.957088 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-61389be9-2127-4d2c-b272-f7d990069f19 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:33.957538 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-61389be9-2127-4d2c-b272-f7d990069f19 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:33.958333 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-61389be9-2127-4d2c-b272-f7d990069f19 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:33.958772 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-61389be9-2127-4d2c-b272-f7d990069f19 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:34.092576 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-61389be9-2127-4d2c-b272-f7d990069f19 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617a19a03f4941dd98022cf3f8397fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:34.100053 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-61389be9-2127-4d2c-b272-f7d990069f19 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a" status: 200 len: 1549 microversion: 2.1 time: 0.157670 Jun 03 10:06:34.100621 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 576/1113] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:33 2022] GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a => generated 1549 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:34.116518 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-36d3054d-bf8a-4f69-b8b3-9242e2d774bd tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:34.117017 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-36d3054d-bf8a-4f69-b8b3-9242e2d774bd tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: c5e57f45-cd85-4221-a195-5abaec163b5a] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:34.123551 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-36d3054d-bf8a-4f69-b8b3-9242e2d774bd tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:34.124002 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-36d3054d-bf8a-4f69-b8b3-9242e2d774bd tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:34.124770 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-36d3054d-bf8a-4f69-b8b3-9242e2d774bd tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:34.125210 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-36d3054d-bf8a-4f69-b8b3-9242e2d774bd tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:34.202051 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-36d3054d-bf8a-4f69-b8b3-9242e2d774bd tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089744 Jun 03 10:06:34.202639 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 538/1114] 10.222.0.45 () {58 vars in 1274 bytes} [Fri Jun 3 10:06:34 2022] GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:06:35.105176 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-ae9681d4-450f-4b56-8662-86c8b9fb8002 req-08190785-6a64-4d2b-9bed-e616a324f3f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5e57f45-cd85-4221-a195-5abaec163b5a", "tag": "d8504749-9ecd-4d58-8b48-705f58c8ba6c"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:06:35.113743 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-ae9681d4-450f-4b56-8662-86c8b9fb8002 req-08190785-6a64-4d2b-9bed-e616a324f3f9 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:35.114234 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-ae9681d4-450f-4b56-8662-86c8b9fb8002 req-08190785-6a64-4d2b-9bed-e616a324f3f9 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:35.125118 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-ae9681d4-450f-4b56-8662-86c8b9fb8002 req-08190785-6a64-4d2b-9bed-e616a324f3f9 service nova] Creating event network-changed:d8504749-9ecd-4d58-8b48-705f58c8ba6c for instance c5e57f45-cd85-4221-a195-5abaec163b5a on hv-cinder-79760 Jun 03 10:06:35.129906 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-ae9681d4-450f-4b56-8662-86c8b9fb8002 req-08190785-6a64-4d2b-9bed-e616a324f3f9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028335 Jun 03 10:06:35.131802 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 577/1115] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 10:06:44.830134 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:06:44.831124 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell1:SELECT=36 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:06:44.835607 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-1970546d-9d36-489f-af6f-55918900ad75 req-aa0e2e9e-64fb-42ab-88d4-b9731ac29377 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a0aa280-d0b4-42e3-8dd4-e222a70d0f10", "tag": "11ea2cd5-6468-4db5-8bec-8a0e6b1acff8"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:06:44.836040 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-35a06ee0-8cc2-4b81-83f8-a9c7c5da73e9 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:44.836672 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-35a06ee0-8cc2-4b81-83f8-a9c7c5da73e9 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:44.844602 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-1970546d-9d36-489f-af6f-55918900ad75 req-aa0e2e9e-64fb-42ab-88d4-b9731ac29377 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:44.844940 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-35a06ee0-8cc2-4b81-83f8-a9c7c5da73e9 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:44.845367 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-1970546d-9d36-489f-af6f-55918900ad75 req-aa0e2e9e-64fb-42ab-88d4-b9731ac29377 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:44.845501 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-35a06ee0-8cc2-4b81-83f8-a9c7c5da73e9 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:44.846367 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-35a06ee0-8cc2-4b81-83f8-a9c7c5da73e9 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:44.846857 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-35a06ee0-8cc2-4b81-83f8-a9c7c5da73e9 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:44.857110 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-1970546d-9d36-489f-af6f-55918900ad75 req-aa0e2e9e-64fb-42ab-88d4-b9731ac29377 service nova] Creating event network-changed:11ea2cd5-6468-4db5-8bec-8a0e6b1acff8 for instance 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 on hv-cinder-79760 Jun 03 10:06:44.862295 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-1970546d-9d36-489f-af6f-55918900ad75 req-aa0e2e9e-64fb-42ab-88d4-b9731ac29377 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031497 Jun 03 10:06:44.863359 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 578/1116] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 10:06:44.877535 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-35a06ee0-8cc2-4b81-83f8-a9c7c5da73e9 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Going to try to terminate instance {{(pid=117648) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 10:06:44.980853 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-35a06ee0-8cc2-4b81-83f8-a9c7c5da73e9 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "DELETE /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 204 len: 0 microversion: 2.1 time: 0.151923 Jun 03 10:06:44.982034 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 539/1117] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jun 3 10:06:44 2022] DELETE /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 10:06:44.992343 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-0873a8d1-15cc-4983-bcfb-95a2eb05801f tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:44.993146 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-0873a8d1-15cc-4983-bcfb-95a2eb05801f tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:44.999839 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0873a8d1-15cc-4983-bcfb-95a2eb05801f tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:45.000597 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0873a8d1-15cc-4983-bcfb-95a2eb05801f tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:45.001587 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0873a8d1-15cc-4983-bcfb-95a2eb05801f tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:45.002084 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0873a8d1-15cc-4983-bcfb-95a2eb05801f tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:45.257642 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-0873a8d1-15cc-4983-bcfb-95a2eb05801f tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:45.265639 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-0873a8d1-15cc-4983-bcfb-95a2eb05801f tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1570 microversion: 2.1 time: 0.278517 Jun 03 10:06:45.266258 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 579/1118] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:44 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1570 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:46.286311 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-e5667a27-a709-412b-b170-0a1af656bace tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:46.287049 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-e5667a27-a709-412b-b170-0a1af656bace tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:46.293766 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e5667a27-a709-412b-b170-0a1af656bace tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:46.294226 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e5667a27-a709-412b-b170-0a1af656bace tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:46.295192 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e5667a27-a709-412b-b170-0a1af656bace tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:46.295420 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e5667a27-a709-412b-b170-0a1af656bace tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:46.488028 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-e5667a27-a709-412b-b170-0a1af656bace tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:46.496755 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-e5667a27-a709-412b-b170-0a1af656bace tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1570 microversion: 2.1 time: 0.215528 Jun 03 10:06:46.497308 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 540/1119] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:46 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1570 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:47.514031 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-6e858ece-cc58-4fcb-a56d-4e5abe830c27 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:47.514650 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-6e858ece-cc58-4fcb-a56d-4e5abe830c27 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:47.520880 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6e858ece-cc58-4fcb-a56d-4e5abe830c27 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:47.521329 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6e858ece-cc58-4fcb-a56d-4e5abe830c27 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:47.522137 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6e858ece-cc58-4fcb-a56d-4e5abe830c27 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:47.522574 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6e858ece-cc58-4fcb-a56d-4e5abe830c27 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:47.647555 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-6e858ece-cc58-4fcb-a56d-4e5abe830c27 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:47.654971 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-6e858ece-cc58-4fcb-a56d-4e5abe830c27 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1570 microversion: 2.1 time: 0.144852 Jun 03 10:06:47.655560 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 580/1120] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:47 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1570 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:48.672320 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-03c82907-f213-4e7e-a46a-eacc2a6aae37 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:48.672874 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-03c82907-f213-4e7e-a46a-eacc2a6aae37 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:48.679473 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-03c82907-f213-4e7e-a46a-eacc2a6aae37 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:48.679926 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-03c82907-f213-4e7e-a46a-eacc2a6aae37 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:48.680693 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-03c82907-f213-4e7e-a46a-eacc2a6aae37 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:48.681135 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-03c82907-f213-4e7e-a46a-eacc2a6aae37 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:49.048028 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-03c82907-f213-4e7e-a46a-eacc2a6aae37 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:49.056097 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-03c82907-f213-4e7e-a46a-eacc2a6aae37 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1570 microversion: 2.1 time: 0.387604 Jun 03 10:06:49.056681 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 541/1121] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:48 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1570 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:50.073353 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-48b5f132-142f-4d16-a5fd-a703f89ded8e tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:50.073991 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-48b5f132-142f-4d16-a5fd-a703f89ded8e tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:50.080247 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-48b5f132-142f-4d16-a5fd-a703f89ded8e tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:50.080692 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-48b5f132-142f-4d16-a5fd-a703f89ded8e tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:50.081454 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-48b5f132-142f-4d16-a5fd-a703f89ded8e tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:50.081926 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-48b5f132-142f-4d16-a5fd-a703f89ded8e tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:50.212109 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-48b5f132-142f-4d16-a5fd-a703f89ded8e tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:50.219618 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-48b5f132-142f-4d16-a5fd-a703f89ded8e tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1451 microversion: 2.1 time: 0.150078 Jun 03 10:06:50.220181 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 581/1122] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:50 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:51.236329 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-0ff33f86-d7dc-4984-9f1e-393dfbc87e3f tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:51.236966 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-0ff33f86-d7dc-4984-9f1e-393dfbc87e3f tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:51.243431 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0ff33f86-d7dc-4984-9f1e-393dfbc87e3f tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:51.243872 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0ff33f86-d7dc-4984-9f1e-393dfbc87e3f tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:51.244621 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0ff33f86-d7dc-4984-9f1e-393dfbc87e3f tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:51.245052 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0ff33f86-d7dc-4984-9f1e-393dfbc87e3f tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:51.375133 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-0ff33f86-d7dc-4984-9f1e-393dfbc87e3f tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:51.382947 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-0ff33f86-d7dc-4984-9f1e-393dfbc87e3f tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1451 microversion: 2.1 time: 0.150454 Jun 03 10:06:51.383510 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 542/1123] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:51 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:52.399833 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-0b7a00ae-79e6-4ac8-967c-e614b8a560b2 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:52.400452 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-0b7a00ae-79e6-4ac8-967c-e614b8a560b2 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:52.402881 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:06:52.408273 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0b7a00ae-79e6-4ac8-967c-e614b8a560b2 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:52.408730 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0b7a00ae-79e6-4ac8-967c-e614b8a560b2 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:52.409497 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0b7a00ae-79e6-4ac8-967c-e614b8a560b2 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:52.409985 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0b7a00ae-79e6-4ac8-967c-e614b8a560b2 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:52.415833 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=57 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:06:52.545031 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-0b7a00ae-79e6-4ac8-967c-e614b8a560b2 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:52.552624 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-0b7a00ae-79e6-4ac8-967c-e614b8a560b2 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1451 microversion: 2.1 time: 0.156852 Jun 03 10:06:52.553267 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 582/1124] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:52 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:52.896127 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 10:06:52.896692 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Fri Jun 3 10:06:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 10:06:53.571483 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-dba4455f-f18a-43f4-b269-d8abe75ca655 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:53.572179 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-dba4455f-f18a-43f4-b269-d8abe75ca655 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:53.579176 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-dba4455f-f18a-43f4-b269-d8abe75ca655 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:53.579728 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-dba4455f-f18a-43f4-b269-d8abe75ca655 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:53.580557 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-dba4455f-f18a-43f4-b269-d8abe75ca655 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:53.581080 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-dba4455f-f18a-43f4-b269-d8abe75ca655 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:53.612313 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-18ed2c9f-d4d4-48ba-8ee2-e334ebbcb19a req-e34a55be-383e-407c-b1c9-713729981401 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a0aa280-d0b4-42e3-8dd4-e222a70d0f10", "name": "network-vif-deleted", "tag": "11ea2cd5-6468-4db5-8bec-8a0e6b1acff8"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:06:53.623809 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-18ed2c9f-d4d4-48ba-8ee2-e334ebbcb19a req-e34a55be-383e-407c-b1c9-713729981401 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:53.624264 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-18ed2c9f-d4d4-48ba-8ee2-e334ebbcb19a req-e34a55be-383e-407c-b1c9-713729981401 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:53.636649 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-18ed2c9f-d4d4-48ba-8ee2-e334ebbcb19a req-e34a55be-383e-407c-b1c9-713729981401 service nova] Creating event network-vif-deleted:11ea2cd5-6468-4db5-8bec-8a0e6b1acff8 for instance 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 on hv-cinder-79760 Jun 03 10:06:53.641476 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-18ed2c9f-d4d4-48ba-8ee2-e334ebbcb19a req-e34a55be-383e-407c-b1c9-713729981401 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032767 Jun 03 10:06:53.642295 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 583/1125] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:06:53.643905 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-dba4455f-f18a-43f4-b269-d8abe75ca655 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:53.651910 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-dba4455f-f18a-43f4-b269-d8abe75ca655 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1383 microversion: 2.1 time: 0.086146 Jun 03 10:06:53.652486 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 543/1126] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:53 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1383 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:54.670165 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-c65bcffc-5257-493f-b96c-2f0213e2472f tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:54.671643 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-c65bcffc-5257-493f-b96c-2f0213e2472f tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:54.681496 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c65bcffc-5257-493f-b96c-2f0213e2472f tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:54.685569 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c65bcffc-5257-493f-b96c-2f0213e2472f tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:54.687079 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c65bcffc-5257-493f-b96c-2f0213e2472f tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:54.687710 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c65bcffc-5257-493f-b96c-2f0213e2472f tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:54.723202 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c65bcffc-5257-493f-b96c-2f0213e2472f tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:54.723648 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c65bcffc-5257-493f-b96c-2f0213e2472f tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:54.724093 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.objects.instance [None req-c65bcffc-5257-493f-b96c-2f0213e2472f tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lazy-loading 'fault' on Instance uuid 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 {{(pid=117647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:06:54.772571 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-c65bcffc-5257-493f-b96c-2f0213e2472f tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b1e4b0732d34ec896c84cb52a297447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '475a588bd5a64b508dadf3d93fa5370c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:06:54.779576 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-c65bcffc-5257-493f-b96c-2f0213e2472f tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 200 len: 1178 microversion: 2.1 time: 0.114468 Jun 03 10:06:54.780212 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 584/1127] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:54 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 1178 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:06:55.796362 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-76d36fcd-2f6f-436b-beee-3ca52961f7e1 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:55.796977 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-76d36fcd-2f6f-436b-beee-3ca52961f7e1 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [instance: 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:06:55.803557 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-76d36fcd-2f6f-436b-beee-3ca52961f7e1 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:55.804015 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-76d36fcd-2f6f-436b-beee-3ca52961f7e1 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:55.804776 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-76d36fcd-2f6f-436b-beee-3ca52961f7e1 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:06:55.805216 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-76d36fcd-2f6f-436b-beee-3ca52961f7e1 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:06:55.818471 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.wsgi [None req-76d36fcd-2f6f-436b-beee-3ca52961f7e1 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] HTTP exception thrown: Instance 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 could not be found. Jun 03 10:06:55.820013 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-76d36fcd-2f6f-436b-beee-3ca52961f7e1 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Request method failure captured: Jun 03 10:06:55.820013 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: request: GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 HTTP/1.1 Jun 03 10:06:55.820013 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept: application/json Jun 03 10:06:55.820013 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept-Encoding: identity Jun 03 10:06:55.820013 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Connection: close Jun 03 10:06:55.820013 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Length: 0 Jun 03 10:06:55.820013 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Type: application/json Jun 03 10:06:55.820013 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Host: 10.222.0.45 Jun 03 10:06:55.820013 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Openstack-System-Scope: None Jun 03 10:06:55.820013 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: User-Agent: python-urllib3/1.26.9 Jun 03 10:06:55.820013 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Auth-Token: gAAAAABimdvJvvRLNCmsD7YHh0Kr44JVUa_-whgE2w7yPriLq0eA7CrGFjK6Xq91PbUjsIaUVPNz3MTXEhT2JZk3UzpIFXRl4iJPmBz6u5yBwPDBOWAnaTzVnbFtrQWU7FbtO2e7ogajthrXxCJAVBpYZIhxY7aUNt0E78qMozETcBVIc51S-M8 Jun 03 10:06:55.820013 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Id: None Jun 03 10:06:55.820013 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Name: None Jun 03 10:06:55.820013 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Identity-Status: Confirmed Jun 03 10:06:55.820013 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Is-Admin-Project: True Jun 03 10:06:55.820013 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Id: default Jun 03 10:06:55.820013 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Name: Default Jun 03 10:06:55.820013 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Id: 475a588bd5a64b508dadf3d93fa5370c Jun 03 10:06:55.820013 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Name: tempest-TestShelveInstance-1416388721 Jun 03 10:06:55.820013 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Role: member,reader Jun 03 10:06:55.820013 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Roles: member,reader Jun 03 10:06:55.821766 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_475a588bd5a64b508dadf3d93fa5370c", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/475a588bd5a64b508dadf3d93fa5370c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/475a588bd5a64b508dadf3d93fa5370c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/475a588bd5a64b508dadf3d93fa5370c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 10:06:55.821766 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant: tempest-TestShelveInstance-1416388721 Jun 03 10:06:55.821766 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Id: 475a588bd5a64b508dadf3d93fa5370c Jun 03 10:06:55.821766 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Name: tempest-TestShelveInstance-1416388721 Jun 03 10:06:55.821766 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User: tempest-TestShelveInstance-1416388721-project Jun 03 10:06:55.821766 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Id: default Jun 03 10:06:55.821766 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Name: Default Jun 03 10:06:55.821766 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Id: 3b1e4b0732d34ec896c84cb52a297447 Jun 03 10:06:55.821766 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Name: tempest-TestShelveInstance-1416388721-project Jun 03 10:06:55.821766 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: method: > Jun 03 10:06:55.821766 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: exception: Instance 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 could not be found. Jun 03 10:06:55.821766 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: action_args: {'id': '6a0aa280-d0b4-42e3-8dd4-e222a70d0f10'} Jun 03 10:06:55.822847 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:06:55.822847 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:06:55.822847 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:06:55.822847 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:06:55.822847 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:06:55.822847 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:06:55.822847 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:06:55.822847 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:06:55.822847 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:06:55.822847 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:06:55.822847 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 could not be found. Jun 03 10:06:55.822847 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:06:55.822847 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:06:55.822847 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:06:55.822847 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:06:55.822847 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:06:55.822847 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:06:55.822847 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:06:55.822847 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:06:55.822847 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:06:55.824714 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:06:55.824714 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:06:55.824714 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:06:55.824714 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:06:55.824714 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:06:55.824714 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:06:55.824714 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:06:55.824714 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 could not be found. Jun 03 10:06:55.824714 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:06:55.824714 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:06:55.824714 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:06:55.824714 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:06:55.824714 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:06:55.824714 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:06:55.824714 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:06:55.824714 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:06:55.824714 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 could not be found. Jun 03 10:06:55.824714 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:06:55.826161 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-76d36fcd-2f6f-436b-beee-3ca52961f7e1 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Returning 404 to user: Instance 6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 could not be found. {{(pid=117648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:06:55.826161 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-76d36fcd-2f6f-436b-beee-3ca52961f7e1 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10" status: 404 len: 111 microversion: 2.1 time: 0.028880 Jun 03 10:06:55.826161 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 544/1128] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:06:55 2022] GET /compute/v2.1/servers/6a0aa280-d0b4-42e3-8dd4-e222a70d0f10 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 03 10:06:55.983381 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-7725bad1-29bc-4743-9b4c-ca1e663735c9 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] Calling method '.version_select at 0x7f5036a1ec10>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:06:55.986549 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7725bad1-29bc-4743-9b4c-ca1e663735c9 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [a788fdaf-4e9d-4727-93d3-67043e7d61c1] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 03 10:06:56.995027 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO oslo.messaging._drivers.impl_rabbit [None req-7725bad1-29bc-4743-9b4c-ca1e663735c9 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] [a788fdaf-4e9d-4727-93d3-67043e7d61c1] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 45956. Jun 03 10:06:57.012625 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-7725bad1-29bc-4743-9b4c-ca1e663735c9 tempest-TestShelveInstance-1416388721 tempest-TestShelveInstance-1416388721-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2036788610" status: 202 len: 0 microversion: 2.1 time: 1.033086 Jun 03 10:06:57.013202 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 585/1129] 10.222.0.45 () {58 vars in 1253 bytes} [Fri Jun 3 10:06:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2036788610 => generated 0 bytes in 1034 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 10:07:21.597024 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-d052c93c-d22a-436d-b78c-5bc5340f3f52 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:21.597601 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-d052c93c-d22a-436d-b78c-5bc5340f3f52 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: c5e57f45-cd85-4221-a195-5abaec163b5a] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:21.599553 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:07:21.600180 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:07:21.607536 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d052c93c-d22a-436d-b78c-5bc5340f3f52 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:21.608015 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d052c93c-d22a-436d-b78c-5bc5340f3f52 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:21.608771 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d052c93c-d22a-436d-b78c-5bc5340f3f52 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:21.609204 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d052c93c-d22a-436d-b78c-5bc5340f3f52 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:21.634067 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-d052c93c-d22a-436d-b78c-5bc5340f3f52 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a/ips" status: 200 len: 146 microversion: 2.1 time: 0.041103 Jun 03 10:07:21.634620 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 545/1130] 10.222.0.45 () {58 vars in 1247 bytes} [Fri Jun 3 10:07:21 2022] GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a/ips => generated 146 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:07:23.792940 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=15 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:07:23.793816 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:07:23.798528 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-6aa86439-0992-4cc1-b166-e9334902490a tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1e057af2-51a4-40ca-ade7-8cc24b76ea45"}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:07:23.799581 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-6aa86439-0992-4cc1-b166-e9334902490a tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: c5e57f45-cd85-4221-a195-5abaec163b5a] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:23.807867 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6aa86439-0992-4cc1-b166-e9334902490a tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:23.808326 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6aa86439-0992-4cc1-b166-e9334902490a tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:23.809094 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6aa86439-0992-4cc1-b166-e9334902490a tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:23.809558 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6aa86439-0992-4cc1-b166-e9334902490a tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:24.055499 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-6aa86439-0992-4cc1-b166-e9334902490a tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "POST /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263959 Jun 03 10:07:24.056254 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 586/1131] 10.222.0.45 () {60 vars in 1322 bytes} [Fri Jun 3 10:07:23 2022] POST /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a/os-volume_attachments => generated 194 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:07:31.533913 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-b5b7bb0d-3d6c-44cd-b0c9-cb63e0cf8728 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:07:31.540695 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b5b7bb0d-3d6c-44cd-b0c9-cb63e0cf8728 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:31.541160 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b5b7bb0d-3d6c-44cd-b0c9-cb63e0cf8728 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:31.601722 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-b5b7bb0d-3d6c-44cd-b0c9-cb63e0cf8728 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: c5e57f45-cd85-4221-a195-5abaec163b5a] Going to try to stop instance {{(pid=117648) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 03 10:07:31.643593 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-b5b7bb0d-3d6c-44cd-b0c9-cb63e0cf8728 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "POST /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a/action" status: 202 len: 0 microversion: 2.1 time: 0.113384 Jun 03 10:07:31.644105 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 546/1132] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jun 3 10:07:31 2022] POST /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 10:07:31.652567 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-429e03b7-5ea0-4295-8d0a-23871eab9aed tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:31.653816 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-429e03b7-5ea0-4295-8d0a-23871eab9aed tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: c5e57f45-cd85-4221-a195-5abaec163b5a] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:31.660528 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-429e03b7-5ea0-4295-8d0a-23871eab9aed tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:31.660983 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-429e03b7-5ea0-4295-8d0a-23871eab9aed tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:31.661776 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-429e03b7-5ea0-4295-8d0a-23871eab9aed tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:31.662211 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-429e03b7-5ea0-4295-8d0a-23871eab9aed tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:31.791333 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-429e03b7-5ea0-4295-8d0a-23871eab9aed tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617a19a03f4941dd98022cf3f8397fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:07:31.799278 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-429e03b7-5ea0-4295-8d0a-23871eab9aed tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a" status: 200 len: 1724 microversion: 2.1 time: 0.150862 Jun 03 10:07:31.799837 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 587/1133] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:07:31 2022] GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:07:32.817306 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-dc2dd145-f7f1-49cc-86cb-8d3ff099d80b tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:32.818039 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-dc2dd145-f7f1-49cc-86cb-8d3ff099d80b tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: c5e57f45-cd85-4221-a195-5abaec163b5a] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:32.824403 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-dc2dd145-f7f1-49cc-86cb-8d3ff099d80b tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:32.824892 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-dc2dd145-f7f1-49cc-86cb-8d3ff099d80b tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:32.826195 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-dc2dd145-f7f1-49cc-86cb-8d3ff099d80b tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:32.826640 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-dc2dd145-f7f1-49cc-86cb-8d3ff099d80b tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:32.957695 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-dc2dd145-f7f1-49cc-86cb-8d3ff099d80b tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617a19a03f4941dd98022cf3f8397fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:07:32.965539 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-dc2dd145-f7f1-49cc-86cb-8d3ff099d80b tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a" status: 200 len: 1724 microversion: 2.1 time: 0.152924 Jun 03 10:07:32.966159 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 547/1134] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:07:32 2022] GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:07:33.983922 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-148820b9-4b26-4b8d-af6e-26454a2b51f0 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:33.984478 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-148820b9-4b26-4b8d-af6e-26454a2b51f0 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: c5e57f45-cd85-4221-a195-5abaec163b5a] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:33.991034 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-148820b9-4b26-4b8d-af6e-26454a2b51f0 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:33.991484 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-148820b9-4b26-4b8d-af6e-26454a2b51f0 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:33.992245 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-148820b9-4b26-4b8d-af6e-26454a2b51f0 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:33.992680 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-148820b9-4b26-4b8d-af6e-26454a2b51f0 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:34.120600 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-148820b9-4b26-4b8d-af6e-26454a2b51f0 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617a19a03f4941dd98022cf3f8397fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:07:34.128560 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-148820b9-4b26-4b8d-af6e-26454a2b51f0 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a" status: 200 len: 1724 microversion: 2.1 time: 0.149134 Jun 03 10:07:34.129134 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 588/1135] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:07:33 2022] GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:07:35.146051 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-a6f9d53a-c85b-4f5c-b610-af1bf9a98dfd tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:35.146690 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-a6f9d53a-c85b-4f5c-b610-af1bf9a98dfd tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: c5e57f45-cd85-4221-a195-5abaec163b5a] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:35.153685 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a6f9d53a-c85b-4f5c-b610-af1bf9a98dfd tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:35.154153 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a6f9d53a-c85b-4f5c-b610-af1bf9a98dfd tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:35.154905 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a6f9d53a-c85b-4f5c-b610-af1bf9a98dfd tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:35.155335 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a6f9d53a-c85b-4f5c-b610-af1bf9a98dfd tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:35.284107 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-a6f9d53a-c85b-4f5c-b610-af1bf9a98dfd tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617a19a03f4941dd98022cf3f8397fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:07:35.292364 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-a6f9d53a-c85b-4f5c-b610-af1bf9a98dfd tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a" status: 200 len: 1724 microversion: 2.1 time: 0.150109 Jun 03 10:07:35.292914 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 548/1136] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:07:35 2022] GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:07:36.310587 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-67777657-c4f2-45d1-9112-bb4fa2165763 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:36.311212 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-67777657-c4f2-45d1-9112-bb4fa2165763 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: c5e57f45-cd85-4221-a195-5abaec163b5a] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:36.317704 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-67777657-c4f2-45d1-9112-bb4fa2165763 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:36.318182 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-67777657-c4f2-45d1-9112-bb4fa2165763 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:36.318944 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-67777657-c4f2-45d1-9112-bb4fa2165763 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:36.319383 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-67777657-c4f2-45d1-9112-bb4fa2165763 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:36.445962 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-67777657-c4f2-45d1-9112-bb4fa2165763 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617a19a03f4941dd98022cf3f8397fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:07:36.453955 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-67777657-c4f2-45d1-9112-bb4fa2165763 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a" status: 200 len: 1724 microversion: 2.1 time: 0.147807 Jun 03 10:07:36.454528 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 589/1137] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:07:36 2022] GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:07:37.470805 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-515d5f50-c503-4644-878b-a6a17f4bf198 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:37.471410 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-515d5f50-c503-4644-878b-a6a17f4bf198 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: c5e57f45-cd85-4221-a195-5abaec163b5a] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:37.477831 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-515d5f50-c503-4644-878b-a6a17f4bf198 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:37.478279 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-515d5f50-c503-4644-878b-a6a17f4bf198 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:37.479036 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-515d5f50-c503-4644-878b-a6a17f4bf198 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:37.479466 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-515d5f50-c503-4644-878b-a6a17f4bf198 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:37.604301 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-515d5f50-c503-4644-878b-a6a17f4bf198 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617a19a03f4941dd98022cf3f8397fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:07:37.612145 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-515d5f50-c503-4644-878b-a6a17f4bf198 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a" status: 200 len: 1724 microversion: 2.1 time: 0.145146 Jun 03 10:07:37.612703 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 549/1138] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:07:37 2022] GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a => generated 1724 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:07:38.628619 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-0e7f228d-c57b-4834-b042-1d81a4bb8c34 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:38.629229 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-0e7f228d-c57b-4834-b042-1d81a4bb8c34 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: c5e57f45-cd85-4221-a195-5abaec163b5a] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:38.635872 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0e7f228d-c57b-4834-b042-1d81a4bb8c34 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:38.636319 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0e7f228d-c57b-4834-b042-1d81a4bb8c34 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:38.637080 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0e7f228d-c57b-4834-b042-1d81a4bb8c34 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:38.638039 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-0e7f228d-c57b-4834-b042-1d81a4bb8c34 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:38.766247 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-0e7f228d-c57b-4834-b042-1d81a4bb8c34 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617a19a03f4941dd98022cf3f8397fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:07:38.774074 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-0e7f228d-c57b-4834-b042-1d81a4bb8c34 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a" status: 200 len: 1724 microversion: 2.1 time: 0.149298 Jun 03 10:07:38.774631 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 590/1139] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:07:38 2022] GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:07:39.791486 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-fa7ae996-a30b-4bef-8150-1fd690b6ee98 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:39.792102 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-fa7ae996-a30b-4bef-8150-1fd690b6ee98 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: c5e57f45-cd85-4221-a195-5abaec163b5a] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:39.799665 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fa7ae996-a30b-4bef-8150-1fd690b6ee98 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:39.800108 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fa7ae996-a30b-4bef-8150-1fd690b6ee98 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:39.800859 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fa7ae996-a30b-4bef-8150-1fd690b6ee98 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:39.801318 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fa7ae996-a30b-4bef-8150-1fd690b6ee98 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:39.926258 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-fa7ae996-a30b-4bef-8150-1fd690b6ee98 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617a19a03f4941dd98022cf3f8397fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:07:39.934010 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-fa7ae996-a30b-4bef-8150-1fd690b6ee98 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a" status: 200 len: 1724 microversion: 2.1 time: 0.146525 Jun 03 10:07:39.934567 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 550/1140] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:07:39 2022] GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:07:40.951350 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-2ab78208-4266-48ea-bd55-bfcab1f44e9a tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:40.951972 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-2ab78208-4266-48ea-bd55-bfcab1f44e9a tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: c5e57f45-cd85-4221-a195-5abaec163b5a] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:40.958472 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2ab78208-4266-48ea-bd55-bfcab1f44e9a tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:40.958912 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2ab78208-4266-48ea-bd55-bfcab1f44e9a tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:40.959682 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2ab78208-4266-48ea-bd55-bfcab1f44e9a tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:40.960127 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2ab78208-4266-48ea-bd55-bfcab1f44e9a tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:41.089426 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-2ab78208-4266-48ea-bd55-bfcab1f44e9a tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617a19a03f4941dd98022cf3f8397fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:07:41.097864 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-2ab78208-4266-48ea-bd55-bfcab1f44e9a tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a" status: 200 len: 1724 microversion: 2.1 time: 0.150450 Jun 03 10:07:41.098434 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 591/1141] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:07:40 2022] GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:07:42.115726 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-b781b7b2-346d-4259-b11d-09a9ea88e22d tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:42.116402 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-b781b7b2-346d-4259-b11d-09a9ea88e22d tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: c5e57f45-cd85-4221-a195-5abaec163b5a] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:42.123317 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b781b7b2-346d-4259-b11d-09a9ea88e22d tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:42.123769 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b781b7b2-346d-4259-b11d-09a9ea88e22d tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:42.124537 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b781b7b2-346d-4259-b11d-09a9ea88e22d tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:42.125074 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b781b7b2-346d-4259-b11d-09a9ea88e22d tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:42.251886 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-b781b7b2-346d-4259-b11d-09a9ea88e22d tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617a19a03f4941dd98022cf3f8397fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:07:42.259735 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-b781b7b2-346d-4259-b11d-09a9ea88e22d tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a" status: 200 len: 1724 microversion: 2.1 time: 0.148050 Jun 03 10:07:42.260301 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 551/1142] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:07:42 2022] GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:07:43.278131 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-4919664d-76ff-44f0-b095-b6f3910b7346 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:43.278676 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-4919664d-76ff-44f0-b095-b6f3910b7346 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: c5e57f45-cd85-4221-a195-5abaec163b5a] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:43.286308 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4919664d-76ff-44f0-b095-b6f3910b7346 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:43.286772 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4919664d-76ff-44f0-b095-b6f3910b7346 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:43.287810 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4919664d-76ff-44f0-b095-b6f3910b7346 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:43.288252 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4919664d-76ff-44f0-b095-b6f3910b7346 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:43.417233 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-4919664d-76ff-44f0-b095-b6f3910b7346 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617a19a03f4941dd98022cf3f8397fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:07:43.425901 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-4919664d-76ff-44f0-b095-b6f3910b7346 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a" status: 200 len: 1724 microversion: 2.1 time: 0.151814 Jun 03 10:07:43.426563 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 592/1143] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:07:43 2022] GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:07:44.443005 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-efd77688-0ccf-4ada-b703-3bb10a2007b3 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:44.443619 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-efd77688-0ccf-4ada-b703-3bb10a2007b3 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: c5e57f45-cd85-4221-a195-5abaec163b5a] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:44.449681 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-efd77688-0ccf-4ada-b703-3bb10a2007b3 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:44.450753 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-efd77688-0ccf-4ada-b703-3bb10a2007b3 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:44.451512 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-efd77688-0ccf-4ada-b703-3bb10a2007b3 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:44.451975 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-efd77688-0ccf-4ada-b703-3bb10a2007b3 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:44.578871 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-efd77688-0ccf-4ada-b703-3bb10a2007b3 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617a19a03f4941dd98022cf3f8397fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:07:44.587175 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-efd77688-0ccf-4ada-b703-3bb10a2007b3 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a" status: 200 len: 1724 microversion: 2.1 time: 0.148122 Jun 03 10:07:44.587731 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 552/1144] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:07:44 2022] GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:07:45.604066 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-1cb84cb6-19b0-4d39-9904-894e133ddf1b tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:45.604684 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-1cb84cb6-19b0-4d39-9904-894e133ddf1b tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: c5e57f45-cd85-4221-a195-5abaec163b5a] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:45.611423 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1cb84cb6-19b0-4d39-9904-894e133ddf1b tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:45.611873 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1cb84cb6-19b0-4d39-9904-894e133ddf1b tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:45.612637 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1cb84cb6-19b0-4d39-9904-894e133ddf1b tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:45.613071 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1cb84cb6-19b0-4d39-9904-894e133ddf1b tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:45.738171 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-1cb84cb6-19b0-4d39-9904-894e133ddf1b tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617a19a03f4941dd98022cf3f8397fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:07:45.746048 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-1cb84cb6-19b0-4d39-9904-894e133ddf1b tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a" status: 200 len: 1724 microversion: 2.1 time: 0.145853 Jun 03 10:07:45.747146 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 593/1145] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:07:45 2022] GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:07:46.763817 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-248894a2-b866-489d-87c1-fcac9f77eed6 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:46.764427 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-248894a2-b866-489d-87c1-fcac9f77eed6 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: c5e57f45-cd85-4221-a195-5abaec163b5a] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:46.770859 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-248894a2-b866-489d-87c1-fcac9f77eed6 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:46.771301 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-248894a2-b866-489d-87c1-fcac9f77eed6 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:46.772049 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-248894a2-b866-489d-87c1-fcac9f77eed6 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:46.772479 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-248894a2-b866-489d-87c1-fcac9f77eed6 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:46.901102 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-248894a2-b866-489d-87c1-fcac9f77eed6 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617a19a03f4941dd98022cf3f8397fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:07:46.909698 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-248894a2-b866-489d-87c1-fcac9f77eed6 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a" status: 200 len: 1724 microversion: 2.1 time: 0.150181 Jun 03 10:07:46.910292 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 553/1146] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:07:46 2022] GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:07:47.927409 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-3bd45f0f-27be-45e9-a083-66840065dd4a tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:47.928057 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-3bd45f0f-27be-45e9-a083-66840065dd4a tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: c5e57f45-cd85-4221-a195-5abaec163b5a] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:47.934710 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3bd45f0f-27be-45e9-a083-66840065dd4a tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:47.935163 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3bd45f0f-27be-45e9-a083-66840065dd4a tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:47.935933 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3bd45f0f-27be-45e9-a083-66840065dd4a tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:47.936373 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3bd45f0f-27be-45e9-a083-66840065dd4a tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:48.063022 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-3bd45f0f-27be-45e9-a083-66840065dd4a tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617a19a03f4941dd98022cf3f8397fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:07:48.070937 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-3bd45f0f-27be-45e9-a083-66840065dd4a tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a" status: 200 len: 1701 microversion: 2.1 time: 0.147367 Jun 03 10:07:48.071509 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 594/1147] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:07:47 2022] GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a => generated 1701 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:07:48.086928 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-1b1b31cc-09a6-4b5b-87df-c24a023b8fae tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:07:48.093916 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1b1b31cc-09a6-4b5b-87df-c24a023b8fae tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:48.094365 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1b1b31cc-09a6-4b5b-87df-c24a023b8fae tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:48.115830 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-1b1b31cc-09a6-4b5b-87df-c24a023b8fae tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: c5e57f45-cd85-4221-a195-5abaec163b5a] Going to try to start instance {{(pid=117648) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 03 10:07:48.155548 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-1b1b31cc-09a6-4b5b-87df-c24a023b8fae tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "POST /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a/action" status: 202 len: 0 microversion: 2.1 time: 0.072289 Jun 03 10:07:48.156118 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 554/1148] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jun 3 10:07:48 2022] POST /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 10:07:48.164457 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-51481a97-4686-4fa8-8ba8-ff27fe3ee736 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:48.165082 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-51481a97-4686-4fa8-8ba8-ff27fe3ee736 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: c5e57f45-cd85-4221-a195-5abaec163b5a] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:48.171674 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-51481a97-4686-4fa8-8ba8-ff27fe3ee736 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:48.172365 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-51481a97-4686-4fa8-8ba8-ff27fe3ee736 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:48.173196 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-51481a97-4686-4fa8-8ba8-ff27fe3ee736 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:48.173680 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-51481a97-4686-4fa8-8ba8-ff27fe3ee736 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:48.311960 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-51481a97-4686-4fa8-8ba8-ff27fe3ee736 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617a19a03f4941dd98022cf3f8397fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:07:48.320387 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-51481a97-4686-4fa8-8ba8-ff27fe3ee736 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a" status: 200 len: 1710 microversion: 2.1 time: 0.160049 Jun 03 10:07:48.321054 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 595/1149] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:07:48 2022] GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a => generated 1710 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:07:49.342062 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-33191f03-a821-49f6-8d06-d8f1ee758d48 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:49.342821 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-33191f03-a821-49f6-8d06-d8f1ee758d48 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: c5e57f45-cd85-4221-a195-5abaec163b5a] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:49.349201 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-33191f03-a821-49f6-8d06-d8f1ee758d48 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:49.349663 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-33191f03-a821-49f6-8d06-d8f1ee758d48 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:49.350471 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-33191f03-a821-49f6-8d06-d8f1ee758d48 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:49.350911 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-33191f03-a821-49f6-8d06-d8f1ee758d48 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:49.539993 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-28508984-0cd9-4cf9-b785-6722e6428088 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:49.540493 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-28508984-0cd9-4cf9-b785-6722e6428088 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: f81cb413-a285-476d-8b7a-62f99fd8fc31] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:49.544197 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-33191f03-a821-49f6-8d06-d8f1ee758d48 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617a19a03f4941dd98022cf3f8397fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:07:49.547476 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-28508984-0cd9-4cf9-b785-6722e6428088 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:49.547924 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-28508984-0cd9-4cf9-b785-6722e6428088 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:49.548707 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-28508984-0cd9-4cf9-b785-6722e6428088 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:49.549151 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-28508984-0cd9-4cf9-b785-6722e6428088 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:49.554864 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-33191f03-a821-49f6-8d06-d8f1ee758d48 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a" status: 200 len: 1710 microversion: 2.1 time: 0.220181 Jun 03 10:07:49.555789 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 555/1150] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:07:49 2022] GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a => generated 1710 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:07:49.577994 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-28508984-0cd9-4cf9-b785-6722e6428088 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: f81cb413-a285-476d-8b7a-62f99fd8fc31] Going to try to terminate instance {{(pid=117647) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 10:07:49.664812 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-28508984-0cd9-4cf9-b785-6722e6428088 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "DELETE /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31" status: 204 len: 0 microversion: 2.1 time: 0.128330 Jun 03 10:07:49.665426 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 596/1151] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jun 3 10:07:49 2022] DELETE /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 03 10:07:49.675202 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-f9b97603-eb5a-4c4c-9f97-f5da7a01fe35 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:49.675915 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-f9b97603-eb5a-4c4c-9f97-f5da7a01fe35 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: f81cb413-a285-476d-8b7a-62f99fd8fc31] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:49.682209 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f9b97603-eb5a-4c4c-9f97-f5da7a01fe35 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:49.682662 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f9b97603-eb5a-4c4c-9f97-f5da7a01fe35 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:49.683545 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f9b97603-eb5a-4c4c-9f97-f5da7a01fe35 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:49.683993 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f9b97603-eb5a-4c4c-9f97-f5da7a01fe35 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:49.729151 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-4ac79e1e-6840-4441-860c-2a131b017069 req-e541089a-2d85-4e88-80be-2d7bb3440a08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f81cb413-a285-476d-8b7a-62f99fd8fc31", "tag": "4a77bec9-e2d9-4e8b-8e47-96c23798d27d"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:07:49.751855 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-4ac79e1e-6840-4441-860c-2a131b017069 req-e541089a-2d85-4e88-80be-2d7bb3440a08 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:49.752634 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-4ac79e1e-6840-4441-860c-2a131b017069 req-e541089a-2d85-4e88-80be-2d7bb3440a08 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:49.766787 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-4ac79e1e-6840-4441-860c-2a131b017069 req-e541089a-2d85-4e88-80be-2d7bb3440a08 service nova] Creating event network-changed:4a77bec9-e2d9-4e8b-8e47-96c23798d27d for instance f81cb413-a285-476d-8b7a-62f99fd8fc31 on hv-cinder-79760 Jun 03 10:07:49.774062 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-4ac79e1e-6840-4441-860c-2a131b017069 req-e541089a-2d85-4e88-80be-2d7bb3440a08 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.217107 Jun 03 10:07:49.774672 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 556/1152] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:07:49.825395 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-f9b97603-eb5a-4c4c-9f97-f5da7a01fe35 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:07:49.833521 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-f9b97603-eb5a-4c4c-9f97-f5da7a01fe35 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31" status: 200 len: 1577 microversion: 2.1 time: 0.162461 Jun 03 10:07:49.834306 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 597/1153] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:07:49 2022] GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31 => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:07:50.573474 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-0d23e58d-1352-41a8-afb1-87291a993e75 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:50.574211 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-0d23e58d-1352-41a8-afb1-87291a993e75 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: c5e57f45-cd85-4221-a195-5abaec163b5a] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:50.580458 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0d23e58d-1352-41a8-afb1-87291a993e75 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:50.580905 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0d23e58d-1352-41a8-afb1-87291a993e75 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:50.581663 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0d23e58d-1352-41a8-afb1-87291a993e75 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:50.582134 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0d23e58d-1352-41a8-afb1-87291a993e75 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:50.711169 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-0d23e58d-1352-41a8-afb1-87291a993e75 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617a19a03f4941dd98022cf3f8397fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:07:50.719148 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-0d23e58d-1352-41a8-afb1-87291a993e75 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a" status: 200 len: 1714 microversion: 2.1 time: 0.150382 Jun 03 10:07:50.719706 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 557/1154] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:07:50 2022] GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a => generated 1714 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:07:50.851286 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-f1426a77-8553-4be1-9206-cedefca80bdc tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:50.851812 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-f1426a77-8553-4be1-9206-cedefca80bdc tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: f81cb413-a285-476d-8b7a-62f99fd8fc31] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:50.859060 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f1426a77-8553-4be1-9206-cedefca80bdc tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:50.859507 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f1426a77-8553-4be1-9206-cedefca80bdc tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:50.860258 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f1426a77-8553-4be1-9206-cedefca80bdc tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:50.860690 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-f1426a77-8553-4be1-9206-cedefca80bdc tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:50.990890 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-f1426a77-8553-4be1-9206-cedefca80bdc tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:07:50.998402 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-f1426a77-8553-4be1-9206-cedefca80bdc tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31" status: 200 len: 1577 microversion: 2.1 time: 0.151028 Jun 03 10:07:50.998976 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 598/1155] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:07:50 2022] GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31 => generated 1577 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:07:52.015489 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-67a15102-fd9a-4a64-b9e1-b29375d37d6c tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:52.016006 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-67a15102-fd9a-4a64-b9e1-b29375d37d6c tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: f81cb413-a285-476d-8b7a-62f99fd8fc31] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:52.019486 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_api:SELECT=27 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:07:52.023656 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-67a15102-fd9a-4a64-b9e1-b29375d37d6c tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:52.024097 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-67a15102-fd9a-4a64-b9e1-b29375d37d6c tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:52.024865 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-67a15102-fd9a-4a64-b9e1-b29375d37d6c tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:52.025296 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-67a15102-fd9a-4a64-b9e1-b29375d37d6c tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:52.028136 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:07:52.165625 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-67a15102-fd9a-4a64-b9e1-b29375d37d6c tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:07:52.173790 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-67a15102-fd9a-4a64-b9e1-b29375d37d6c tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31" status: 200 len: 1577 microversion: 2.1 time: 0.162224 Jun 03 10:07:52.174353 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 558/1156] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:07:52 2022] GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31 => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:07:53.062820 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-93c0e243-7c7d-4e90-bcb3-ed11e11f2a64 req-008f3133-54c6-4e1f-9e40-9ff8dd9e7568 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f81cb413-a285-476d-8b7a-62f99fd8fc31", "name": "network-vif-deleted", "tag": "4a77bec9-e2d9-4e8b-8e47-96c23798d27d"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:07:53.070846 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-93c0e243-7c7d-4e90-bcb3-ed11e11f2a64 req-008f3133-54c6-4e1f-9e40-9ff8dd9e7568 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:53.071283 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-93c0e243-7c7d-4e90-bcb3-ed11e11f2a64 req-008f3133-54c6-4e1f-9e40-9ff8dd9e7568 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:53.083932 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-93c0e243-7c7d-4e90-bcb3-ed11e11f2a64 req-008f3133-54c6-4e1f-9e40-9ff8dd9e7568 service nova] Creating event network-vif-deleted:4a77bec9-e2d9-4e8b-8e47-96c23798d27d for instance f81cb413-a285-476d-8b7a-62f99fd8fc31 on hv-cinder-79760 Jun 03 10:07:53.088667 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-93c0e243-7c7d-4e90-bcb3-ed11e11f2a64 req-008f3133-54c6-4e1f-9e40-9ff8dd9e7568 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090040 Jun 03 10:07:53.089267 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 599/1157] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:07:53.191132 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-44795601-575b-4a56-9094-967e8c3cb286 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:53.191752 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-44795601-575b-4a56-9094-967e8c3cb286 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: f81cb413-a285-476d-8b7a-62f99fd8fc31] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:53.198302 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-44795601-575b-4a56-9094-967e8c3cb286 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:53.198754 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-44795601-575b-4a56-9094-967e8c3cb286 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:53.199549 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-44795601-575b-4a56-9094-967e8c3cb286 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:53.199986 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-44795601-575b-4a56-9094-967e8c3cb286 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:53.259360 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-44795601-575b-4a56-9094-967e8c3cb286 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:07:53.267944 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-44795601-575b-4a56-9094-967e8c3cb286 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31" status: 200 len: 1225 microversion: 2.1 time: 0.080543 Jun 03 10:07:53.268770 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 559/1158] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:07:53 2022] GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:07:54.286202 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-b80e2e80-9236-44fd-bf0e-96014c2c4d36 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:54.286966 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-b80e2e80-9236-44fd-bf0e-96014c2c4d36 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: f81cb413-a285-476d-8b7a-62f99fd8fc31] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:54.289805 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:07:54.295815 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b80e2e80-9236-44fd-bf0e-96014c2c4d36 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:54.296289 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b80e2e80-9236-44fd-bf0e-96014c2c4d36 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:54.297055 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b80e2e80-9236-44fd-bf0e-96014c2c4d36 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:54.297498 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b80e2e80-9236-44fd-bf0e-96014c2c4d36 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:54.302022 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:07:54.312174 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.wsgi [None req-b80e2e80-9236-44fd-bf0e-96014c2c4d36 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] HTTP exception thrown: Instance f81cb413-a285-476d-8b7a-62f99fd8fc31 could not be found. Jun 03 10:07:54.313831 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-b80e2e80-9236-44fd-bf0e-96014c2c4d36 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Request method failure captured: Jun 03 10:07:54.313831 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: request: GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31 HTTP/1.1 Jun 03 10:07:54.313831 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Accept: application/json Jun 03 10:07:54.313831 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Accept-Encoding: identity Jun 03 10:07:54.313831 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Connection: close Jun 03 10:07:54.313831 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Content-Length: 0 Jun 03 10:07:54.313831 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Content-Type: application/json Jun 03 10:07:54.313831 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Host: 10.222.0.45 Jun 03 10:07:54.313831 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Openstack-System-Scope: None Jun 03 10:07:54.313831 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: User-Agent: python-urllib3/1.26.9 Jun 03 10:07:54.313831 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Auth-Token: gAAAAABimdtQkRJx_lDKaTLCSgHYIdXBlDDoyslMJ_zPSH-RJq9FS8U8B4Aw4eXzN-IlQda_wzGyCfaxxAE7Bw424ZP6JKCgbz4VJRUs4SHXEFfUK8erLksClDIHuzRQhbNPhsDA5NBUVq-LLAnH9wyEWEwcZE_HmJc4SsF3szinipa_gfm-aoU Jun 03 10:07:54.313831 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Domain-Id: None Jun 03 10:07:54.313831 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Domain-Name: None Jun 03 10:07:54.313831 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Identity-Status: Confirmed Jun 03 10:07:54.313831 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Is-Admin-Project: True Jun 03 10:07:54.313831 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Domain-Id: default Jun 03 10:07:54.313831 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Domain-Name: Default Jun 03 10:07:54.313831 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Id: 8a878ecfb9cd47b684c027beb6ad0b03 Jun 03 10:07:54.313831 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Name: tempest-TestVolumeBootPattern-1979259018 Jun 03 10:07:54.313831 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Role: member,reader Jun 03 10:07:54.313831 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Roles: member,reader Jun 03 10:07:54.315474 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_8a878ecfb9cd47b684c027beb6ad0b03", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/8a878ecfb9cd47b684c027beb6ad0b03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8a878ecfb9cd47b684c027beb6ad0b03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8a878ecfb9cd47b684c027beb6ad0b03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 10:07:54.315474 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant: tempest-TestVolumeBootPattern-1979259018 Jun 03 10:07:54.315474 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant-Id: 8a878ecfb9cd47b684c027beb6ad0b03 Jun 03 10:07:54.315474 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant-Name: tempest-TestVolumeBootPattern-1979259018 Jun 03 10:07:54.315474 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User: tempest-TestVolumeBootPattern-1979259018-project Jun 03 10:07:54.315474 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Domain-Id: default Jun 03 10:07:54.315474 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Domain-Name: Default Jun 03 10:07:54.315474 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Id: 397ff11fedcc4d17867e1d9c10fcd10f Jun 03 10:07:54.315474 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Name: tempest-TestVolumeBootPattern-1979259018-project Jun 03 10:07:54.315474 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: method: > Jun 03 10:07:54.315474 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: exception: Instance f81cb413-a285-476d-8b7a-62f99fd8fc31 could not be found. Jun 03 10:07:54.315474 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: action_args: {'id': 'f81cb413-a285-476d-8b7a-62f99fd8fc31'} Jun 03 10:07:54.316449 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:07:54.316449 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:07:54.316449 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:07:54.316449 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:07:54.316449 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:07:54.316449 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:07:54.316449 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:07:54.316449 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:07:54.316449 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:07:54.316449 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:07:54.316449 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f81cb413-a285-476d-8b7a-62f99fd8fc31 could not be found. Jun 03 10:07:54.316449 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:07:54.316449 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:07:54.316449 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:07:54.316449 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:07:54.316449 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:07:54.316449 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:07:54.316449 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:07:54.316449 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:07:54.316449 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:07:54.318066 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:07:54.318066 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:07:54.318066 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:07:54.318066 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:07:54.318066 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:07:54.318066 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:07:54.318066 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:07:54.318066 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f81cb413-a285-476d-8b7a-62f99fd8fc31 could not be found. Jun 03 10:07:54.318066 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:07:54.318066 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:07:54.318066 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:07:54.318066 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:07:54.318066 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:07:54.318066 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:07:54.318066 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:07:54.318066 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:07:54.318066 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f81cb413-a285-476d-8b7a-62f99fd8fc31 could not be found. Jun 03 10:07:54.318066 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:07:54.319529 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-b80e2e80-9236-44fd-bf0e-96014c2c4d36 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Returning 404 to user: Instance f81cb413-a285-476d-8b7a-62f99fd8fc31 could not be found. {{(pid=117647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:07:54.319529 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-b80e2e80-9236-44fd-bf0e-96014c2c4d36 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31" status: 404 len: 111 microversion: 2.1 time: 0.033494 Jun 03 10:07:54.319529 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 600/1159] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:07:54 2022] GET /compute/v2.1/servers/f81cb413-a285-476d-8b7a-62f99fd8fc31 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 10:07:57.580925 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-c879c923-2c24-4abe-aa5e-1714d2a1f4c5 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:57.581424 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-c879c923-2c24-4abe-aa5e-1714d2a1f4c5 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: 2aaaa62d-a26a-4cde-8ee5-151fde85889d] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:57.582701 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-21e51311-64ce-492d-8be3-4580cb8af7c7 req-f57e780b-b9a4-4516-99e6-c5223eab6e10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2aaaa62d-a26a-4cde-8ee5-151fde85889d", "tag": "2990d842-a125-4da9-948a-c2237e5cbd36"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:07:57.587973 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c879c923-2c24-4abe-aa5e-1714d2a1f4c5 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:57.588428 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c879c923-2c24-4abe-aa5e-1714d2a1f4c5 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:57.589208 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c879c923-2c24-4abe-aa5e-1714d2a1f4c5 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:57.589650 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-c879c923-2c24-4abe-aa5e-1714d2a1f4c5 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:57.592807 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-21e51311-64ce-492d-8be3-4580cb8af7c7 req-f57e780b-b9a4-4516-99e6-c5223eab6e10 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:57.593479 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-21e51311-64ce-492d-8be3-4580cb8af7c7 req-f57e780b-b9a4-4516-99e6-c5223eab6e10 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:57.605059 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-21e51311-64ce-492d-8be3-4580cb8af7c7 req-f57e780b-b9a4-4516-99e6-c5223eab6e10 service nova] Creating event network-changed:2990d842-a125-4da9-948a-c2237e5cbd36 for instance 2aaaa62d-a26a-4cde-8ee5-151fde85889d on hv-cinder-79760 Jun 03 10:07:57.609984 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-21e51311-64ce-492d-8be3-4580cb8af7c7 req-f57e780b-b9a4-4516-99e6-c5223eab6e10 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030762 Jun 03 10:07:57.610775 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 601/1160] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:07:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 10:07:57.616632 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-c879c923-2c24-4abe-aa5e-1714d2a1f4c5 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: 2aaaa62d-a26a-4cde-8ee5-151fde85889d] Going to try to terminate instance {{(pid=117648) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 10:07:57.701038 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-c879c923-2c24-4abe-aa5e-1714d2a1f4c5 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "DELETE /compute/v2.1/servers/2aaaa62d-a26a-4cde-8ee5-151fde85889d" status: 204 len: 0 microversion: 2.1 time: 0.124212 Jun 03 10:07:57.702995 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 560/1161] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jun 3 10:07:57 2022] DELETE /compute/v2.1/servers/2aaaa62d-a26a-4cde-8ee5-151fde85889d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 10:07:57.714799 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-b0085f0d-9515-4cb0-b647-a06fb940388e tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:57.715624 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-b0085f0d-9515-4cb0-b647-a06fb940388e tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: 2aaaa62d-a26a-4cde-8ee5-151fde85889d] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:57.722081 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b0085f0d-9515-4cb0-b647-a06fb940388e tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:57.722611 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b0085f0d-9515-4cb0-b647-a06fb940388e tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:57.723454 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b0085f0d-9515-4cb0-b647-a06fb940388e tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:57.724005 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b0085f0d-9515-4cb0-b647-a06fb940388e tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:57.859758 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-b0085f0d-9515-4cb0-b647-a06fb940388e tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:07:57.867318 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-b0085f0d-9515-4cb0-b647-a06fb940388e tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/2aaaa62d-a26a-4cde-8ee5-151fde85889d" status: 200 len: 1579 microversion: 2.1 time: 0.159704 Jun 03 10:07:57.867891 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 602/1162] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:07:57 2022] GET /compute/v2.1/servers/2aaaa62d-a26a-4cde-8ee5-151fde85889d => generated 1579 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:07:58.885405 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-aedc0ba1-4e88-4882-a224-03fe0b86adb7 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:07:58.886056 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-aedc0ba1-4e88-4882-a224-03fe0b86adb7 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: 2aaaa62d-a26a-4cde-8ee5-151fde85889d] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:07:58.893043 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-aedc0ba1-4e88-4882-a224-03fe0b86adb7 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:58.893491 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-aedc0ba1-4e88-4882-a224-03fe0b86adb7 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:58.894282 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-aedc0ba1-4e88-4882-a224-03fe0b86adb7 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:07:58.894721 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-aedc0ba1-4e88-4882-a224-03fe0b86adb7 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:07:59.030656 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-aedc0ba1-4e88-4882-a224-03fe0b86adb7 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:07:59.038534 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-aedc0ba1-4e88-4882-a224-03fe0b86adb7 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/2aaaa62d-a26a-4cde-8ee5-151fde85889d" status: 200 len: 1579 microversion: 2.1 time: 0.157413 Jun 03 10:07:59.039095 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 561/1163] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:07:58 2022] GET /compute/v2.1/servers/2aaaa62d-a26a-4cde-8ee5-151fde85889d => generated 1579 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:08:00.055548 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-4ae21276-d7eb-46ca-abcf-c73a66f61951 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:00.056843 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-4ae21276-d7eb-46ca-abcf-c73a66f61951 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: 2aaaa62d-a26a-4cde-8ee5-151fde85889d] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:00.059251 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-cec3203c-6986-4e71-bab3-3086759b7de0 req-40546b8f-4517-477e-9bf2-718d708ba3ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2aaaa62d-a26a-4cde-8ee5-151fde85889d", "name": "network-vif-deleted", "tag": "2990d842-a125-4da9-948a-c2237e5cbd36"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:08:00.065010 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4ae21276-d7eb-46ca-abcf-c73a66f61951 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:00.065177 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4ae21276-d7eb-46ca-abcf-c73a66f61951 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:00.066132 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4ae21276-d7eb-46ca-abcf-c73a66f61951 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:00.066669 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-4ae21276-d7eb-46ca-abcf-c73a66f61951 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:00.068888 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-cec3203c-6986-4e71-bab3-3086759b7de0 req-40546b8f-4517-477e-9bf2-718d708ba3ac service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:00.069332 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-cec3203c-6986-4e71-bab3-3086759b7de0 req-40546b8f-4517-477e-9bf2-718d708ba3ac service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:00.081147 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-cec3203c-6986-4e71-bab3-3086759b7de0 req-40546b8f-4517-477e-9bf2-718d708ba3ac service nova] Creating event network-vif-deleted:2990d842-a125-4da9-948a-c2237e5cbd36 for instance 2aaaa62d-a26a-4cde-8ee5-151fde85889d on hv-cinder-79760 Jun 03 10:08:00.091884 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-cec3203c-6986-4e71-bab3-3086759b7de0 req-40546b8f-4517-477e-9bf2-718d708ba3ac service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035940 Jun 03 10:08:00.092977 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 562/1164] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 10:08:00.132741 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-4ae21276-d7eb-46ca-abcf-c73a66f61951 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '397ff11fedcc4d17867e1d9c10fcd10f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a878ecfb9cd47b684c027beb6ad0b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:08:00.141031 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-4ae21276-d7eb-46ca-abcf-c73a66f61951 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/2aaaa62d-a26a-4cde-8ee5-151fde85889d" status: 200 len: 1393 microversion: 2.1 time: 0.089478 Jun 03 10:08:00.141605 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 603/1165] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:08:00 2022] GET /compute/v2.1/servers/2aaaa62d-a26a-4cde-8ee5-151fde85889d => generated 1393 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:08:01.159458 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-85b036d0-f5c8-4973-be1a-52e1824c1a06 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:01.160089 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-85b036d0-f5c8-4973-be1a-52e1824c1a06 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: 2aaaa62d-a26a-4cde-8ee5-151fde85889d] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:01.166509 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-85b036d0-f5c8-4973-be1a-52e1824c1a06 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:01.166950 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-85b036d0-f5c8-4973-be1a-52e1824c1a06 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:01.167703 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-85b036d0-f5c8-4973-be1a-52e1824c1a06 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:01.168133 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-85b036d0-f5c8-4973-be1a-52e1824c1a06 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:01.180901 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.wsgi [None req-85b036d0-f5c8-4973-be1a-52e1824c1a06 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] HTTP exception thrown: Instance 2aaaa62d-a26a-4cde-8ee5-151fde85889d could not be found. Jun 03 10:08:01.182493 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-85b036d0-f5c8-4973-be1a-52e1824c1a06 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Request method failure captured: Jun 03 10:08:01.182493 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: request: GET /compute/v2.1/servers/2aaaa62d-a26a-4cde-8ee5-151fde85889d HTTP/1.1 Jun 03 10:08:01.182493 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept: application/json Jun 03 10:08:01.182493 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept-Encoding: identity Jun 03 10:08:01.182493 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Connection: close Jun 03 10:08:01.182493 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Length: 0 Jun 03 10:08:01.182493 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Type: application/json Jun 03 10:08:01.182493 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Host: 10.222.0.45 Jun 03 10:08:01.182493 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Openstack-System-Scope: None Jun 03 10:08:01.182493 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: User-Agent: python-urllib3/1.26.9 Jun 03 10:08:01.182493 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Auth-Token: gAAAAABimdtQkRJx_lDKaTLCSgHYIdXBlDDoyslMJ_zPSH-RJq9FS8U8B4Aw4eXzN-IlQda_wzGyCfaxxAE7Bw424ZP6JKCgbz4VJRUs4SHXEFfUK8erLksClDIHuzRQhbNPhsDA5NBUVq-LLAnH9wyEWEwcZE_HmJc4SsF3szinipa_gfm-aoU Jun 03 10:08:01.182493 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Id: None Jun 03 10:08:01.182493 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Name: None Jun 03 10:08:01.182493 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Identity-Status: Confirmed Jun 03 10:08:01.182493 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Is-Admin-Project: True Jun 03 10:08:01.182493 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Id: default Jun 03 10:08:01.182493 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Name: Default Jun 03 10:08:01.182493 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Id: 8a878ecfb9cd47b684c027beb6ad0b03 Jun 03 10:08:01.182493 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Name: tempest-TestVolumeBootPattern-1979259018 Jun 03 10:08:01.182493 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Role: member,reader Jun 03 10:08:01.182493 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Roles: member,reader Jun 03 10:08:01.184156 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_8a878ecfb9cd47b684c027beb6ad0b03", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/8a878ecfb9cd47b684c027beb6ad0b03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8a878ecfb9cd47b684c027beb6ad0b03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8a878ecfb9cd47b684c027beb6ad0b03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 10:08:01.184156 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant: tempest-TestVolumeBootPattern-1979259018 Jun 03 10:08:01.184156 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Id: 8a878ecfb9cd47b684c027beb6ad0b03 Jun 03 10:08:01.184156 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Name: tempest-TestVolumeBootPattern-1979259018 Jun 03 10:08:01.184156 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User: tempest-TestVolumeBootPattern-1979259018-project Jun 03 10:08:01.184156 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Id: default Jun 03 10:08:01.184156 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Name: Default Jun 03 10:08:01.184156 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Id: 397ff11fedcc4d17867e1d9c10fcd10f Jun 03 10:08:01.184156 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Name: tempest-TestVolumeBootPattern-1979259018-project Jun 03 10:08:01.184156 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: method: > Jun 03 10:08:01.184156 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: exception: Instance 2aaaa62d-a26a-4cde-8ee5-151fde85889d could not be found. Jun 03 10:08:01.184156 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: action_args: {'id': '2aaaa62d-a26a-4cde-8ee5-151fde85889d'} Jun 03 10:08:01.185109 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:08:01.185109 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:08:01.185109 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:08:01.185109 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:08:01.185109 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:08:01.185109 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:08:01.185109 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:08:01.185109 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:08:01.185109 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:08:01.185109 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:08:01.185109 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2aaaa62d-a26a-4cde-8ee5-151fde85889d could not be found. Jun 03 10:08:01.185109 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:08:01.185109 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:08:01.185109 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:08:01.185109 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:08:01.185109 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:08:01.185109 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:08:01.185109 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:08:01.185109 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:08:01.185109 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:08:01.186783 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:08:01.186783 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:08:01.186783 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:08:01.186783 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:08:01.186783 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:08:01.186783 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:08:01.186783 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:08:01.186783 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2aaaa62d-a26a-4cde-8ee5-151fde85889d could not be found. Jun 03 10:08:01.186783 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:08:01.186783 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:08:01.186783 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:08:01.186783 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:08:01.186783 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:08:01.186783 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:08:01.186783 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:08:01.186783 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:08:01.186783 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2aaaa62d-a26a-4cde-8ee5-151fde85889d could not be found. Jun 03 10:08:01.186783 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:08:01.188429 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-85b036d0-f5c8-4973-be1a-52e1824c1a06 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Returning 404 to user: Instance 2aaaa62d-a26a-4cde-8ee5-151fde85889d could not be found. {{(pid=117648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:08:01.188429 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-85b036d0-f5c8-4973-be1a-52e1824c1a06 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/2aaaa62d-a26a-4cde-8ee5-151fde85889d" status: 404 len: 111 microversion: 2.1 time: 0.029833 Jun 03 10:08:01.188429 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 563/1166] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:08:01 2022] GET /compute/v2.1/servers/2aaaa62d-a26a-4cde-8ee5-151fde85889d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 10:08:01.622727 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-73be38b1-4f53-4852-96f9-d4e56b8c1188 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:01.623875 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-73be38b1-4f53-4852-96f9-d4e56b8c1188 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: ac4d607d-8ff8-4931-b17d-460fda9c0917] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:01.630261 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-73be38b1-4f53-4852-96f9-d4e56b8c1188 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:01.630735 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-73be38b1-4f53-4852-96f9-d4e56b8c1188 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:01.631497 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-73be38b1-4f53-4852-96f9-d4e56b8c1188 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:01.631933 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-73be38b1-4f53-4852-96f9-d4e56b8c1188 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:01.645788 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.wsgi [None req-73be38b1-4f53-4852-96f9-d4e56b8c1188 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] HTTP exception thrown: Instance ac4d607d-8ff8-4931-b17d-460fda9c0917 could not be found. Jun 03 10:08:01.647421 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-73be38b1-4f53-4852-96f9-d4e56b8c1188 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Request method failure captured: Jun 03 10:08:01.647421 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: request: DELETE /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917 HTTP/1.1 Jun 03 10:08:01.647421 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Accept: application/json Jun 03 10:08:01.647421 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Accept-Encoding: identity Jun 03 10:08:01.647421 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Connection: close Jun 03 10:08:01.647421 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Content-Length: 0 Jun 03 10:08:01.647421 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Content-Type: application/json Jun 03 10:08:01.647421 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Host: 10.222.0.45 Jun 03 10:08:01.647421 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Openstack-System-Scope: None Jun 03 10:08:01.647421 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: User-Agent: python-urllib3/1.26.9 Jun 03 10:08:01.647421 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Auth-Token: gAAAAABimdtQkRJx_lDKaTLCSgHYIdXBlDDoyslMJ_zPSH-RJq9FS8U8B4Aw4eXzN-IlQda_wzGyCfaxxAE7Bw424ZP6JKCgbz4VJRUs4SHXEFfUK8erLksClDIHuzRQhbNPhsDA5NBUVq-LLAnH9wyEWEwcZE_HmJc4SsF3szinipa_gfm-aoU Jun 03 10:08:01.647421 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Domain-Id: None Jun 03 10:08:01.647421 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Domain-Name: None Jun 03 10:08:01.647421 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Identity-Status: Confirmed Jun 03 10:08:01.647421 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Is-Admin-Project: True Jun 03 10:08:01.647421 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Domain-Id: default Jun 03 10:08:01.647421 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Domain-Name: Default Jun 03 10:08:01.647421 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Id: 8a878ecfb9cd47b684c027beb6ad0b03 Jun 03 10:08:01.647421 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Name: tempest-TestVolumeBootPattern-1979259018 Jun 03 10:08:01.647421 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Role: member,reader Jun 03 10:08:01.647421 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Roles: member,reader Jun 03 10:08:01.648998 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_8a878ecfb9cd47b684c027beb6ad0b03", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/8a878ecfb9cd47b684c027beb6ad0b03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8a878ecfb9cd47b684c027beb6ad0b03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8a878ecfb9cd47b684c027beb6ad0b03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 10:08:01.648998 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant: tempest-TestVolumeBootPattern-1979259018 Jun 03 10:08:01.648998 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant-Id: 8a878ecfb9cd47b684c027beb6ad0b03 Jun 03 10:08:01.648998 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant-Name: tempest-TestVolumeBootPattern-1979259018 Jun 03 10:08:01.648998 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User: tempest-TestVolumeBootPattern-1979259018-project Jun 03 10:08:01.648998 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Domain-Id: default Jun 03 10:08:01.648998 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Domain-Name: Default Jun 03 10:08:01.648998 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Id: 397ff11fedcc4d17867e1d9c10fcd10f Jun 03 10:08:01.648998 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Name: tempest-TestVolumeBootPattern-1979259018-project Jun 03 10:08:01.648998 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: method: > Jun 03 10:08:01.648998 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: exception: Instance ac4d607d-8ff8-4931-b17d-460fda9c0917 could not be found. Jun 03 10:08:01.648998 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: action_args: {'id': 'ac4d607d-8ff8-4931-b17d-460fda9c0917'} Jun 03 10:08:01.649967 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:08:01.649967 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:08:01.649967 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:08:01.649967 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:08:01.649967 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:08:01.649967 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:08:01.649967 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:08:01.649967 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:08:01.649967 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:08:01.649967 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:08:01.649967 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac4d607d-8ff8-4931-b17d-460fda9c0917 could not be found. Jun 03 10:08:01.649967 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:08:01.649967 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:08:01.649967 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:08:01.649967 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:08:01.649967 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:08:01.649967 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:08:01.649967 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:08:01.649967 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:08:01.649967 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:08:01.651500 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:08:01.651500 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 10:08:01.651500 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 10:08:01.651500 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 10:08:01.651500 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 10:08:01.651500 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:08:01.651500 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:08:01.651500 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:08:01.651500 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:08:01.651500 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac4d607d-8ff8-4931-b17d-460fda9c0917 could not be found. Jun 03 10:08:01.651500 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:08:01.651500 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:08:01.651500 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:08:01.651500 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:08:01.651500 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:08:01.651500 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:08:01.651500 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:08:01.651500 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:08:01.651500 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac4d607d-8ff8-4931-b17d-460fda9c0917 could not be found. Jun 03 10:08:01.651500 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:08:01.652961 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-73be38b1-4f53-4852-96f9-d4e56b8c1188 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Returning 404 to user: Instance ac4d607d-8ff8-4931-b17d-460fda9c0917 could not be found. {{(pid=117647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:08:01.652961 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-73be38b1-4f53-4852-96f9-d4e56b8c1188 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "DELETE /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917" status: 404 len: 111 microversion: 2.1 time: 0.029982 Jun 03 10:08:01.652961 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 604/1167] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jun 3 10:08:01 2022] DELETE /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 10:08:01.657284 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-4d344436-2b21-437d-8e7d-6b656970410b tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:01.657935 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-4d344436-2b21-437d-8e7d-6b656970410b tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] [instance: ac4d607d-8ff8-4931-b17d-460fda9c0917] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:01.664176 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4d344436-2b21-437d-8e7d-6b656970410b tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:01.664622 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4d344436-2b21-437d-8e7d-6b656970410b tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:01.665388 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4d344436-2b21-437d-8e7d-6b656970410b tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:01.665857 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4d344436-2b21-437d-8e7d-6b656970410b tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:01.687136 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.wsgi [None req-4d344436-2b21-437d-8e7d-6b656970410b tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] HTTP exception thrown: Instance ac4d607d-8ff8-4931-b17d-460fda9c0917 could not be found. Jun 03 10:08:01.689050 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-4d344436-2b21-437d-8e7d-6b656970410b tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Request method failure captured: Jun 03 10:08:01.689050 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: request: GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917 HTTP/1.1 Jun 03 10:08:01.689050 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept: application/json Jun 03 10:08:01.689050 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept-Encoding: identity Jun 03 10:08:01.689050 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Connection: close Jun 03 10:08:01.689050 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Length: 0 Jun 03 10:08:01.689050 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Type: application/json Jun 03 10:08:01.689050 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Host: 10.222.0.45 Jun 03 10:08:01.689050 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Openstack-System-Scope: None Jun 03 10:08:01.689050 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: User-Agent: python-urllib3/1.26.9 Jun 03 10:08:01.689050 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Auth-Token: gAAAAABimdtQkRJx_lDKaTLCSgHYIdXBlDDoyslMJ_zPSH-RJq9FS8U8B4Aw4eXzN-IlQda_wzGyCfaxxAE7Bw424ZP6JKCgbz4VJRUs4SHXEFfUK8erLksClDIHuzRQhbNPhsDA5NBUVq-LLAnH9wyEWEwcZE_HmJc4SsF3szinipa_gfm-aoU Jun 03 10:08:01.689050 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Id: None Jun 03 10:08:01.689050 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Name: None Jun 03 10:08:01.689050 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Identity-Status: Confirmed Jun 03 10:08:01.689050 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Is-Admin-Project: True Jun 03 10:08:01.689050 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Id: default Jun 03 10:08:01.689050 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Name: Default Jun 03 10:08:01.689050 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Id: 8a878ecfb9cd47b684c027beb6ad0b03 Jun 03 10:08:01.689050 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Name: tempest-TestVolumeBootPattern-1979259018 Jun 03 10:08:01.689050 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Role: member,reader Jun 03 10:08:01.689050 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Roles: member,reader Jun 03 10:08:01.691264 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_8a878ecfb9cd47b684c027beb6ad0b03", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/8a878ecfb9cd47b684c027beb6ad0b03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8a878ecfb9cd47b684c027beb6ad0b03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/8a878ecfb9cd47b684c027beb6ad0b03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 10:08:01.691264 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant: tempest-TestVolumeBootPattern-1979259018 Jun 03 10:08:01.691264 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Id: 8a878ecfb9cd47b684c027beb6ad0b03 Jun 03 10:08:01.691264 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Name: tempest-TestVolumeBootPattern-1979259018 Jun 03 10:08:01.691264 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User: tempest-TestVolumeBootPattern-1979259018-project Jun 03 10:08:01.691264 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Id: default Jun 03 10:08:01.691264 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Name: Default Jun 03 10:08:01.691264 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Id: 397ff11fedcc4d17867e1d9c10fcd10f Jun 03 10:08:01.691264 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Name: tempest-TestVolumeBootPattern-1979259018-project Jun 03 10:08:01.691264 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: method: > Jun 03 10:08:01.691264 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: exception: Instance ac4d607d-8ff8-4931-b17d-460fda9c0917 could not be found. Jun 03 10:08:01.691264 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: action_args: {'id': 'ac4d607d-8ff8-4931-b17d-460fda9c0917'} Jun 03 10:08:01.692102 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:08:01.692102 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:08:01.692102 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:08:01.692102 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:08:01.692102 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:08:01.692102 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:08:01.692102 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:08:01.692102 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:08:01.692102 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:08:01.692102 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:08:01.692102 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac4d607d-8ff8-4931-b17d-460fda9c0917 could not be found. Jun 03 10:08:01.692102 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:08:01.692102 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:08:01.692102 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:08:01.692102 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:08:01.692102 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:08:01.692102 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:08:01.692102 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:08:01.692102 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:08:01.692102 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:08:01.693379 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:08:01.693379 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:08:01.693379 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:08:01.693379 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:08:01.693379 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:08:01.693379 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:08:01.693379 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:08:01.693379 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac4d607d-8ff8-4931-b17d-460fda9c0917 could not be found. Jun 03 10:08:01.693379 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:08:01.693379 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:08:01.693379 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:08:01.693379 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:08:01.693379 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:08:01.693379 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:08:01.693379 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:08:01.693379 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:08:01.693379 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac4d607d-8ff8-4931-b17d-460fda9c0917 could not be found. Jun 03 10:08:01.693379 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:08:01.694545 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-4d344436-2b21-437d-8e7d-6b656970410b tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Returning 404 to user: Instance ac4d607d-8ff8-4931-b17d-460fda9c0917 could not be found. {{(pid=117648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:08:01.694545 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-4d344436-2b21-437d-8e7d-6b656970410b tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917" status: 404 len: 111 microversion: 2.1 time: 0.036949 Jun 03 10:08:01.694545 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 564/1168] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:08:01 2022] GET /compute/v2.1/servers/ac4d607d-8ff8-4931-b17d-460fda9c0917 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 10:08:02.975927 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-545ef103-eb3b-41c2-b94b-4422516f1796 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] Calling method '.version_select at 0x7f5036ae9820>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:02.996538 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-545ef103-eb3b-41c2-b94b-4422516f1796 tempest-TestVolumeBootPattern-1979259018 tempest-TestVolumeBootPattern-1979259018-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1925739570" status: 202 len: 0 microversion: 2.1 time: 0.024488 Jun 03 10:08:02.997229 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 605/1169] 10.222.0.45 () {58 vars in 1262 bytes} [Fri Jun 3 10:08:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1925739570 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 10:08:23.114428 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-b75cd655-ee61-4955-b874-aee54dc55c15 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:23.114954 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-b75cd655-ee61-4955-b874-aee54dc55c15 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: c5e57f45-cd85-4221-a195-5abaec163b5a] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:23.118283 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:08:23.119084 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:08:23.127991 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b75cd655-ee61-4955-b874-aee54dc55c15 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:23.128444 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b75cd655-ee61-4955-b874-aee54dc55c15 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:23.129255 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b75cd655-ee61-4955-b874-aee54dc55c15 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:23.129700 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-b75cd655-ee61-4955-b874-aee54dc55c15 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:23.211044 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.objects.instance [None req-b75cd655-ee61-4955-b874-aee54dc55c15 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lazy-loading 'services' on Instance uuid c5e57f45-cd85-4221-a195-5abaec163b5a {{(pid=117648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:08:23.282923 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-b75cd655-ee61-4955-b874-aee54dc55c15 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a/os-volume_attachments/1e057af2-51a4-40ca-ade7-8cc24b76ea45" status: 202 len: 0 microversion: 2.1 time: 0.172422 Jun 03 10:08:23.283623 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 565/1170] 10.222.0.45 () {58 vars in 1415 bytes} [Fri Jun 3 10:08:23 2022] DELETE /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a/os-volume_attachments/1e057af2-51a4-40ca-ade7-8cc24b76ea45 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 10:08:24.394364 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=17 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:08:24.395106 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:08:24.399525 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-78a77fa2-0b61-41a5-befd-36c298595ff0 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:08:24.409608 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-78a77fa2-0b61-41a5-befd-36c298595ff0 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:24.410258 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-78a77fa2-0b61-41a5-befd-36c298595ff0 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:24.471790 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-78a77fa2-0b61-41a5-befd-36c298595ff0 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: c5e57f45-cd85-4221-a195-5abaec163b5a] Going to try to stop instance {{(pid=117647) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 03 10:08:24.512695 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-78a77fa2-0b61-41a5-befd-36c298595ff0 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "POST /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a/action" status: 202 len: 0 microversion: 2.1 time: 0.119640 Jun 03 10:08:24.513351 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 606/1171] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jun 3 10:08:24 2022] POST /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 03 10:08:24.523102 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-6b9603ab-8f65-4a87-9681-ee142188ca41 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:24.523803 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-6b9603ab-8f65-4a87-9681-ee142188ca41 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: c5e57f45-cd85-4221-a195-5abaec163b5a] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:24.530439 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6b9603ab-8f65-4a87-9681-ee142188ca41 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:24.530883 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6b9603ab-8f65-4a87-9681-ee142188ca41 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:24.531646 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6b9603ab-8f65-4a87-9681-ee142188ca41 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:24.532252 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6b9603ab-8f65-4a87-9681-ee142188ca41 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:24.662582 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-6b9603ab-8f65-4a87-9681-ee142188ca41 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617a19a03f4941dd98022cf3f8397fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:08:24.670569 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-6b9603ab-8f65-4a87-9681-ee142188ca41 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a" status: 200 len: 1678 microversion: 2.1 time: 0.152124 Jun 03 10:08:24.671128 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 566/1172] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:08:24 2022] GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:08:25.688669 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-238b7657-5074-43da-8f59-8a3c1ba0f2c2 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:25.689380 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-238b7657-5074-43da-8f59-8a3c1ba0f2c2 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: c5e57f45-cd85-4221-a195-5abaec163b5a] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:25.695665 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-238b7657-5074-43da-8f59-8a3c1ba0f2c2 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:25.696117 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-238b7657-5074-43da-8f59-8a3c1ba0f2c2 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:25.696885 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-238b7657-5074-43da-8f59-8a3c1ba0f2c2 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:25.697325 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-238b7657-5074-43da-8f59-8a3c1ba0f2c2 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:25.829346 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-238b7657-5074-43da-8f59-8a3c1ba0f2c2 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617a19a03f4941dd98022cf3f8397fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:08:25.836866 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-238b7657-5074-43da-8f59-8a3c1ba0f2c2 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a" status: 200 len: 1678 microversion: 2.1 time: 0.152864 Jun 03 10:08:25.837432 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 607/1173] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:08:25 2022] GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:08:26.854021 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-06b15464-1851-4e48-83f7-659f680dd8b9 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:26.854620 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-06b15464-1851-4e48-83f7-659f680dd8b9 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: c5e57f45-cd85-4221-a195-5abaec163b5a] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:26.861083 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-06b15464-1851-4e48-83f7-659f680dd8b9 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:26.861529 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-06b15464-1851-4e48-83f7-659f680dd8b9 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:26.862318 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-06b15464-1851-4e48-83f7-659f680dd8b9 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:26.862753 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-06b15464-1851-4e48-83f7-659f680dd8b9 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:26.999074 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-06b15464-1851-4e48-83f7-659f680dd8b9 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617a19a03f4941dd98022cf3f8397fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:08:27.007018 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-06b15464-1851-4e48-83f7-659f680dd8b9 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a" status: 200 len: 1678 microversion: 2.1 time: 0.156893 Jun 03 10:08:27.007572 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 567/1174] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:08:26 2022] GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:08:28.024462 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-33900aa4-b03f-4425-acf2-58698f7cb5cd tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:28.025014 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-33900aa4-b03f-4425-acf2-58698f7cb5cd tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: c5e57f45-cd85-4221-a195-5abaec163b5a] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:28.032155 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-33900aa4-b03f-4425-acf2-58698f7cb5cd tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:28.032608 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-33900aa4-b03f-4425-acf2-58698f7cb5cd tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:28.033368 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-33900aa4-b03f-4425-acf2-58698f7cb5cd tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:28.033851 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-33900aa4-b03f-4425-acf2-58698f7cb5cd tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:28.162207 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-33900aa4-b03f-4425-acf2-58698f7cb5cd tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617a19a03f4941dd98022cf3f8397fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:08:28.169819 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-33900aa4-b03f-4425-acf2-58698f7cb5cd tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a" status: 200 len: 1678 microversion: 2.1 time: 0.149332 Jun 03 10:08:28.170377 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 608/1175] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:08:28 2022] GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:08:29.186749 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-44f32ff1-6743-4c66-905d-1eee052e2ecb tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:29.187324 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-44f32ff1-6743-4c66-905d-1eee052e2ecb tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: c5e57f45-cd85-4221-a195-5abaec163b5a] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:29.193770 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-44f32ff1-6743-4c66-905d-1eee052e2ecb tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:29.194232 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-44f32ff1-6743-4c66-905d-1eee052e2ecb tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:29.195001 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-44f32ff1-6743-4c66-905d-1eee052e2ecb tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:29.195447 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-44f32ff1-6743-4c66-905d-1eee052e2ecb tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:29.326032 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-44f32ff1-6743-4c66-905d-1eee052e2ecb tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617a19a03f4941dd98022cf3f8397fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:08:29.333429 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-44f32ff1-6743-4c66-905d-1eee052e2ecb tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a" status: 200 len: 1678 microversion: 2.1 time: 0.150620 Jun 03 10:08:29.334027 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 568/1176] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:08:29 2022] GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:08:30.350360 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-2d0b63d4-6065-49f3-b3cf-307d225e3322 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:30.350971 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-2d0b63d4-6065-49f3-b3cf-307d225e3322 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: c5e57f45-cd85-4221-a195-5abaec163b5a] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:30.357428 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2d0b63d4-6065-49f3-b3cf-307d225e3322 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:30.357929 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2d0b63d4-6065-49f3-b3cf-307d225e3322 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:30.359218 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2d0b63d4-6065-49f3-b3cf-307d225e3322 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:30.359648 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2d0b63d4-6065-49f3-b3cf-307d225e3322 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:30.491018 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-2d0b63d4-6065-49f3-b3cf-307d225e3322 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617a19a03f4941dd98022cf3f8397fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:08:30.498536 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-2d0b63d4-6065-49f3-b3cf-307d225e3322 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a" status: 200 len: 1655 microversion: 2.1 time: 0.152056 Jun 03 10:08:30.499106 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 609/1177] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:08:30 2022] GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a => generated 1655 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:08:30.515234 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-13abe6d5-dbb2-4643-b282-5d73e46b2bf5 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:08:30.521689 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-13abe6d5-dbb2-4643-b282-5d73e46b2bf5 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:30.522195 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-13abe6d5-dbb2-4643-b282-5d73e46b2bf5 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:30.544112 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-13abe6d5-dbb2-4643-b282-5d73e46b2bf5 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: c5e57f45-cd85-4221-a195-5abaec163b5a] Going to try to start instance {{(pid=117648) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 03 10:08:30.585151 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-13abe6d5-dbb2-4643-b282-5d73e46b2bf5 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "POST /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a/action" status: 202 len: 0 microversion: 2.1 time: 0.073619 Jun 03 10:08:30.585740 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 569/1178] 10.222.0.45 () {60 vars in 1277 bytes} [Fri Jun 3 10:08:30 2022] POST /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a/action => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 10:08:30.595337 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-13154aea-cd0e-4939-b91b-996bee21e849 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:30.595946 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-13154aea-cd0e-4939-b91b-996bee21e849 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: c5e57f45-cd85-4221-a195-5abaec163b5a] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:30.602245 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-13154aea-cd0e-4939-b91b-996bee21e849 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:30.602706 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-13154aea-cd0e-4939-b91b-996bee21e849 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:30.603656 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-13154aea-cd0e-4939-b91b-996bee21e849 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:30.604014 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-13154aea-cd0e-4939-b91b-996bee21e849 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:30.737100 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-13154aea-cd0e-4939-b91b-996bee21e849 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617a19a03f4941dd98022cf3f8397fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:08:30.744595 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-13154aea-cd0e-4939-b91b-996bee21e849 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a" status: 200 len: 1664 microversion: 2.1 time: 0.153599 Jun 03 10:08:30.745170 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 610/1179] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:08:30 2022] GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a => generated 1664 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:08:31.762450 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-7c098d21-c54c-45bd-b9c6-cc41c6694347 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:31.763171 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-7c098d21-c54c-45bd-b9c6-cc41c6694347 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: c5e57f45-cd85-4221-a195-5abaec163b5a] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:31.770292 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7c098d21-c54c-45bd-b9c6-cc41c6694347 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:31.770749 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7c098d21-c54c-45bd-b9c6-cc41c6694347 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:31.771582 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7c098d21-c54c-45bd-b9c6-cc41c6694347 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:31.772025 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-7c098d21-c54c-45bd-b9c6-cc41c6694347 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:31.898033 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-7c098d21-c54c-45bd-b9c6-cc41c6694347 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617a19a03f4941dd98022cf3f8397fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:08:31.905425 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-7c098d21-c54c-45bd-b9c6-cc41c6694347 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a" status: 200 len: 1664 microversion: 2.1 time: 0.147259 Jun 03 10:08:31.906027 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 570/1180] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:08:31 2022] GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a => generated 1664 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:08:32.923155 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-c6bb564b-0a7c-45ad-8d68-d307ed40b267 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:08:32.923772 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-c6bb564b-0a7c-45ad-8d68-d307ed40b267 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: c5e57f45-cd85-4221-a195-5abaec163b5a] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:08:32.930365 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c6bb564b-0a7c-45ad-8d68-d307ed40b267 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:32.930823 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c6bb564b-0a7c-45ad-8d68-d307ed40b267 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:32.931592 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c6bb564b-0a7c-45ad-8d68-d307ed40b267 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:08:32.932054 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c6bb564b-0a7c-45ad-8d68-d307ed40b267 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:08:33.061045 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-c6bb564b-0a7c-45ad-8d68-d307ed40b267 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617a19a03f4941dd98022cf3f8397fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:08:33.069619 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-c6bb564b-0a7c-45ad-8d68-d307ed40b267 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a" status: 200 len: 1668 microversion: 2.1 time: 0.150396 Jun 03 10:08:33.070222 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 611/1181] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:08:32 2022] GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a => generated 1668 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:09:05.492502 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-fc9d9d18-fc70-400d-ac9a-82fd3ed25607 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:09:05.493472 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-fc9d9d18-fc70-400d-ac9a-82fd3ed25607 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: c5e57f45-cd85-4221-a195-5abaec163b5a] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:09:05.496219 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_api:SELECT=12 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:09:05.496867 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:09:05.503221 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fc9d9d18-fc70-400d-ac9a-82fd3ed25607 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:05.503665 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fc9d9d18-fc70-400d-ac9a-82fd3ed25607 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:05.505079 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fc9d9d18-fc70-400d-ac9a-82fd3ed25607 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:05.505511 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-fc9d9d18-fc70-400d-ac9a-82fd3ed25607 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:05.534875 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-fc9d9d18-fc70-400d-ac9a-82fd3ed25607 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046918 Jun 03 10:09:05.535431 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 571/1182] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 3 10:09:05 2022] GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 10:09:05.591209 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-b9e7ebf0-f6e6-4629-99da-39be23ac138e tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:09:05.591697 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-b9e7ebf0-f6e6-4629-99da-39be23ac138e tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: c5e57f45-cd85-4221-a195-5abaec163b5a] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:09:05.594077 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_api:SELECT=12 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:09:05.594900 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:09:05.601221 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b9e7ebf0-f6e6-4629-99da-39be23ac138e tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:05.601679 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b9e7ebf0-f6e6-4629-99da-39be23ac138e tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:05.602472 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b9e7ebf0-f6e6-4629-99da-39be23ac138e tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:05.602909 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b9e7ebf0-f6e6-4629-99da-39be23ac138e tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:05.628476 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-b9e7ebf0-f6e6-4629-99da-39be23ac138e tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: c5e57f45-cd85-4221-a195-5abaec163b5a] Going to try to terminate instance {{(pid=117647) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 10:09:05.702518 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-b9e7ebf0-f6e6-4629-99da-39be23ac138e tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a" status: 204 len: 0 microversion: 2.1 time: 0.114713 Jun 03 10:09:05.703279 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 612/1183] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jun 3 10:09:05 2022] DELETE /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 10:09:05.712066 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-1a38390b-9378-4d5a-b246-3d568054a456 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:09:05.712689 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-1a38390b-9378-4d5a-b246-3d568054a456 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: c5e57f45-cd85-4221-a195-5abaec163b5a] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:09:05.718675 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1a38390b-9378-4d5a-b246-3d568054a456 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:05.719131 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1a38390b-9378-4d5a-b246-3d568054a456 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:05.719896 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1a38390b-9378-4d5a-b246-3d568054a456 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:05.720338 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1a38390b-9378-4d5a-b246-3d568054a456 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:05.845003 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-1a38390b-9378-4d5a-b246-3d568054a456 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617a19a03f4941dd98022cf3f8397fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:09:05.852959 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-1a38390b-9378-4d5a-b246-3d568054a456 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a" status: 200 len: 1674 microversion: 2.1 time: 0.144821 Jun 03 10:09:05.853528 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 572/1184] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:09:05 2022] GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a => generated 1674 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:09:06.871333 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-5b232864-1730-457e-bf5f-3f891587111f tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:09:06.872047 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-5b232864-1730-457e-bf5f-3f891587111f tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: c5e57f45-cd85-4221-a195-5abaec163b5a] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:09:06.878563 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5b232864-1730-457e-bf5f-3f891587111f tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:06.879035 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5b232864-1730-457e-bf5f-3f891587111f tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:06.880403 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5b232864-1730-457e-bf5f-3f891587111f tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:06.880843 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-5b232864-1730-457e-bf5f-3f891587111f tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:07.006203 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-5b232864-1730-457e-bf5f-3f891587111f tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617a19a03f4941dd98022cf3f8397fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:09:07.013571 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-5b232864-1730-457e-bf5f-3f891587111f tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a" status: 200 len: 1674 microversion: 2.1 time: 0.146444 Jun 03 10:09:07.014169 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 613/1185] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:09:06 2022] GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a => generated 1674 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:09:08.030150 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-0a1e5975-f41d-4faf-a911-d9e3127fe095 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:09:08.030694 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-0a1e5975-f41d-4faf-a911-d9e3127fe095 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: c5e57f45-cd85-4221-a195-5abaec163b5a] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:09:08.037212 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0a1e5975-f41d-4faf-a911-d9e3127fe095 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:08.037653 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0a1e5975-f41d-4faf-a911-d9e3127fe095 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:08.038705 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0a1e5975-f41d-4faf-a911-d9e3127fe095 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:08.039137 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-0a1e5975-f41d-4faf-a911-d9e3127fe095 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:08.171566 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-0a1e5975-f41d-4faf-a911-d9e3127fe095 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617a19a03f4941dd98022cf3f8397fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:09:08.179503 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-0a1e5975-f41d-4faf-a911-d9e3127fe095 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a" status: 200 len: 1674 microversion: 2.1 time: 0.153203 Jun 03 10:09:08.180084 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 573/1186] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:09:08 2022] GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:09:08.862422 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-e2a4b2ad-61d1-4faf-b134-43a85c4c9c4b req-57e23101-8cb3-4bef-8c8c-a1f8fabf66f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5e57f45-cd85-4221-a195-5abaec163b5a", "name": "network-vif-deleted", "tag": "d8504749-9ecd-4d58-8b48-705f58c8ba6c"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:09:08.873789 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-e2a4b2ad-61d1-4faf-b134-43a85c4c9c4b req-57e23101-8cb3-4bef-8c8c-a1f8fabf66f9 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:08.874242 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-e2a4b2ad-61d1-4faf-b134-43a85c4c9c4b req-57e23101-8cb3-4bef-8c8c-a1f8fabf66f9 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:08.886314 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-e2a4b2ad-61d1-4faf-b134-43a85c4c9c4b req-57e23101-8cb3-4bef-8c8c-a1f8fabf66f9 service nova] Creating event network-vif-deleted:d8504749-9ecd-4d58-8b48-705f58c8ba6c for instance c5e57f45-cd85-4221-a195-5abaec163b5a on hv-cinder-79760 Jun 03 10:09:08.891523 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-e2a4b2ad-61d1-4faf-b134-43a85c4c9c4b req-57e23101-8cb3-4bef-8c8c-a1f8fabf66f9 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032576 Jun 03 10:09:08.892324 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 614/1187] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:09:09.196343 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-e32e33d0-2bf9-4494-8bae-77cce040c90c tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:09:09.197013 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-e32e33d0-2bf9-4494-8bae-77cce040c90c tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: c5e57f45-cd85-4221-a195-5abaec163b5a] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:09:09.203429 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e32e33d0-2bf9-4494-8bae-77cce040c90c tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:09.203871 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e32e33d0-2bf9-4494-8bae-77cce040c90c tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:09.204630 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e32e33d0-2bf9-4494-8bae-77cce040c90c tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:09.205059 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e32e33d0-2bf9-4494-8bae-77cce040c90c tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:09.236723 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e32e33d0-2bf9-4494-8bae-77cce040c90c tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:09.237164 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e32e33d0-2bf9-4494-8bae-77cce040c90c tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:09.237636 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.objects.instance [None req-e32e33d0-2bf9-4494-8bae-77cce040c90c tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lazy-loading 'fault' on Instance uuid c5e57f45-cd85-4221-a195-5abaec163b5a {{(pid=117648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:09:09.277677 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-e32e33d0-2bf9-4494-8bae-77cce040c90c tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617a19a03f4941dd98022cf3f8397fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:09:09.285270 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-e32e33d0-2bf9-4494-8bae-77cce040c90c tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a" status: 200 len: 1327 microversion: 2.1 time: 0.092680 Jun 03 10:09:09.286891 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 574/1188] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:09:09 2022] GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a => generated 1327 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:09:10.304422 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-276421c5-3c3e-4229-b08c-b8ba7b95bca1 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:09:10.305158 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-276421c5-3c3e-4229-b08c-b8ba7b95bca1 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: c5e57f45-cd85-4221-a195-5abaec163b5a] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:09:10.311843 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-276421c5-3c3e-4229-b08c-b8ba7b95bca1 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:10.312326 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-276421c5-3c3e-4229-b08c-b8ba7b95bca1 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:10.313086 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-276421c5-3c3e-4229-b08c-b8ba7b95bca1 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:10.313524 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-276421c5-3c3e-4229-b08c-b8ba7b95bca1 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:10.326326 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.wsgi [None req-276421c5-3c3e-4229-b08c-b8ba7b95bca1 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] HTTP exception thrown: Instance c5e57f45-cd85-4221-a195-5abaec163b5a could not be found. Jun 03 10:09:10.327888 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-276421c5-3c3e-4229-b08c-b8ba7b95bca1 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Request method failure captured: Jun 03 10:09:10.327888 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: request: GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a HTTP/1.1 Jun 03 10:09:10.327888 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Accept: application/json Jun 03 10:09:10.327888 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Accept-Encoding: identity Jun 03 10:09:10.327888 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Connection: close Jun 03 10:09:10.327888 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Content-Length: 0 Jun 03 10:09:10.327888 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Content-Type: application/json Jun 03 10:09:10.327888 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Host: 10.222.0.45 Jun 03 10:09:10.327888 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Openstack-System-Scope: None Jun 03 10:09:10.327888 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: User-Agent: python-urllib3/1.26.9 Jun 03 10:09:10.327888 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Auth-Token: gAAAAABimd0c1bQwAMqoi7wOOUGvnF9O4UjSjRQHEkE5OW6dW4Bw9TsHKmezt1mMLiJlWU37Wa_QT7dcGsr104zApmGUxqR3tA_EDsbS0ZfT_2dokn2piNFrjkFG8BqminbczBFSewlGIcNfJbg3ayAM-9tMPQGUQuEGLxFxCBJeVnaARNwHUPw Jun 03 10:09:10.327888 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Domain-Id: None Jun 03 10:09:10.327888 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Domain-Name: None Jun 03 10:09:10.327888 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Identity-Status: Confirmed Jun 03 10:09:10.327888 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Is-Admin-Project: True Jun 03 10:09:10.327888 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Domain-Id: default Jun 03 10:09:10.327888 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Domain-Name: Default Jun 03 10:09:10.327888 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Id: 02a9ee05c1ee47e08b2f7c1601dda3c2 Jun 03 10:09:10.327888 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Name: tempest-AttachVolumeTestJSON-623627224 Jun 03 10:09:10.327888 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Role: member,reader Jun 03 10:09:10.327888 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Roles: member,reader Jun 03 10:09:10.329664 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_02a9ee05c1ee47e08b2f7c1601dda3c2", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/02a9ee05c1ee47e08b2f7c1601dda3c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/02a9ee05c1ee47e08b2f7c1601dda3c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/02a9ee05c1ee47e08b2f7c1601dda3c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 10:09:10.329664 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant: tempest-AttachVolumeTestJSON-623627224 Jun 03 10:09:10.329664 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant-Id: 02a9ee05c1ee47e08b2f7c1601dda3c2 Jun 03 10:09:10.329664 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant-Name: tempest-AttachVolumeTestJSON-623627224 Jun 03 10:09:10.329664 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User: tempest-AttachVolumeTestJSON-623627224-project Jun 03 10:09:10.329664 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Domain-Id: default Jun 03 10:09:10.329664 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Domain-Name: Default Jun 03 10:09:10.329664 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Id: 617a19a03f4941dd98022cf3f8397fef Jun 03 10:09:10.329664 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Name: tempest-AttachVolumeTestJSON-623627224-project Jun 03 10:09:10.329664 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: method: > Jun 03 10:09:10.329664 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: exception: Instance c5e57f45-cd85-4221-a195-5abaec163b5a could not be found. Jun 03 10:09:10.329664 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: action_args: {'id': 'c5e57f45-cd85-4221-a195-5abaec163b5a'} Jun 03 10:09:10.330754 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:09:10.330754 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:09:10.330754 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:09:10.330754 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:09:10.330754 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:09:10.330754 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:09:10.330754 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:09:10.330754 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:09:10.330754 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:09:10.330754 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:09:10.330754 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5e57f45-cd85-4221-a195-5abaec163b5a could not be found. Jun 03 10:09:10.330754 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:09:10.330754 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:09:10.330754 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:09:10.330754 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:09:10.330754 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:09:10.330754 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:09:10.330754 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:09:10.330754 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:09:10.330754 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:09:10.332352 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:09:10.332352 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:09:10.332352 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:09:10.332352 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:09:10.332352 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:09:10.332352 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:09:10.332352 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:09:10.332352 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5e57f45-cd85-4221-a195-5abaec163b5a could not be found. Jun 03 10:09:10.332352 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:09:10.332352 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:09:10.332352 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:09:10.332352 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:09:10.332352 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:09:10.332352 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:09:10.332352 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:09:10.332352 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:09:10.332352 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5e57f45-cd85-4221-a195-5abaec163b5a could not be found. Jun 03 10:09:10.332352 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:09:10.333800 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-276421c5-3c3e-4229-b08c-b8ba7b95bca1 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Returning 404 to user: Instance c5e57f45-cd85-4221-a195-5abaec163b5a could not be found. {{(pid=117647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:09:10.333800 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-276421c5-3c3e-4229-b08c-b8ba7b95bca1 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a" status: 404 len: 111 microversion: 2.1 time: 0.029599 Jun 03 10:09:10.333800 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 615/1189] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:09:10 2022] GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 10:09:10.338143 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-2df1f812-0d2e-4712-a517-7d2f638705b7 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '.version_select at 0x7f5036db2670>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:09:10.355089 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-2df1f812-0d2e-4712-a517-7d2f638705b7 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1823751609" status: 202 len: 0 microversion: 2.1 time: 0.020672 Jun 03 10:09:10.355632 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 575/1190] 10.222.0.45 () {58 vars in 1220 bytes} [Fri Jun 3 10:09:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1823751609 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 10:09:10.964693 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-7e9b1ca1-8787-4dbe-a3f7-bd9a0d4b0b67 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Action: 'create', calling method: .version_select at 0x7f503fe78e50>, body: {"keypair": {"name": "tempest-keypair-1918363024", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEv2FeIf/zjQSy7kmlRIiBu6Lkfa47iPNK6hXzvyiRHD/C6EaaoNGeLkOC0vY0MH2xDtuzCo4TpXQkUZpP36B0Kc5U/guTXKzK1evlDSZqHZT7vq9piZF8mYh2GKaqaMHw=="}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:09:10.978324 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-7e9b1ca1-8787-4dbe-a3f7-bd9a0d4b0b67 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Getting quotas for project 02a9ee05c1ee47e08b2f7c1601dda3c2. Resources: {'key_pairs'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 10:09:10.982125 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-7e9b1ca1-8787-4dbe-a3f7-bd9a0d4b0b67 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Getting quotas for user 617a19a03f4941dd98022cf3f8397fef and project 02a9ee05c1ee47e08b2f7c1601dda3c2. Resources: {'key_pairs'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 10:09:11.002906 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-7e9b1ca1-8787-4dbe-a3f7-bd9a0d4b0b67 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.042038 Jun 03 10:09:11.003478 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 616/1191] 10.222.0.45 () {60 vars in 1158 bytes} [Fri Jun 3 10:09:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:09:12.523106 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-792b68e7-026e-45f2-b50a-c08a5c361263 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-63286352", "imageRef": "0cb3b007-4e95-448b-8acb-895d8acdb244", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5805b222-7daa-4d0b-86d7-cd458608951c"}], "security_groups": [{"name": "tempest-securitygroup--1310414962"}], "key_name": "tempest-keypair-1918363024", "user_data": "}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:09:12.625564 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.network.neutron [None req-792b68e7-026e-45f2-b50a-c08a5c361263 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] validate_networks() for [('5805b222-7daa-4d0b-86d7-cd458608951c', None, None, None, None, None)] {{(pid=117648) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 10:09:13.133155 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-792b68e7-026e-45f2-b50a-c08a5c361263 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Flavor limits 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 10:09:13.133575 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-792b68e7-026e-45f2-b50a-c08a5c361263 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Image limits 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 10:09:13.134090 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-792b68e7-026e-45f2-b50a-c08a5c361263 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Flavor pref 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 10:09:13.134523 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-792b68e7-026e-45f2-b50a-c08a5c361263 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Image pref 0:0:0 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 10:09:13.134930 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.virt.hardware [None req-792b68e7-026e-45f2-b50a-c08a5c361263 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 10:09:13.143606 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-792b68e7-026e-45f2-b50a-c08a5c361263 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:13.144049 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-792b68e7-026e-45f2-b50a-c08a5c361263 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:13.145036 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-792b68e7-026e-45f2-b50a-c08a5c361263 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:13.145470 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-792b68e7-026e-45f2-b50a-c08a5c361263 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:13.162104 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-792b68e7-026e-45f2-b50a-c08a5c361263 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Getting quotas for project 02a9ee05c1ee47e08b2f7c1601dda3c2. Resources: {'ram', 'cores', 'instances'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 10:09:13.166233 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.quota [None req-792b68e7-026e-45f2-b50a-c08a5c361263 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Getting quotas for user 617a19a03f4941dd98022cf3f8397fef and project 02a9ee05c1ee47e08b2f7c1601dda3c2. Resources: {'ram', 'cores', 'instances'} {{(pid=117648) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 10:09:13.177373 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-792b68e7-026e-45f2-b50a-c08a5c361263 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Going to run 1 instances... {{(pid=117648) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 10:09:13.179602 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-792b68e7-026e-45f2-b50a-c08a5c361263 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: bd2900bc-2530-434e-906a-7edefd20e4b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0cb3b007-4e95-448b-8acb-895d8acdb244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117648) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 10:09:13.226246 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-792b68e7-026e-45f2-b50a-c08a5c361263 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.708536 Jun 03 10:09:13.226876 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 576/1192] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jun 3 10:09:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 10:09:13.237313 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-15279c2d-b74f-4c4f-a6cd-e0425eccb620 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:09:13.237961 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-15279c2d-b74f-4c4f-a6cd-e0425eccb620 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: bd2900bc-2530-434e-906a-7edefd20e4b2] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:09:13.296677 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-15279c2d-b74f-4c4f-a6cd-e0425eccb620 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617a19a03f4941dd98022cf3f8397fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:09:13.304003 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-15279c2d-b74f-4c4f-a6cd-e0425eccb620 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2" status: 200 len: 1236 microversion: 2.1 time: 0.071011 Jun 03 10:09:13.304756 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 617/1193] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:09:13 2022] GET /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2 => generated 1236 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:09:14.321356 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-078a321c-8057-4da9-8592-580e8f01dd1e tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:09:14.321986 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-078a321c-8057-4da9-8592-580e8f01dd1e tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: bd2900bc-2530-434e-906a-7edefd20e4b2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:09:14.328784 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-078a321c-8057-4da9-8592-580e8f01dd1e tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:14.329232 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-078a321c-8057-4da9-8592-580e8f01dd1e tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:14.330029 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-078a321c-8057-4da9-8592-580e8f01dd1e tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:14.330476 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-078a321c-8057-4da9-8592-580e8f01dd1e tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:14.397662 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-078a321c-8057-4da9-8592-580e8f01dd1e tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617a19a03f4941dd98022cf3f8397fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:09:14.405331 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-078a321c-8057-4da9-8592-580e8f01dd1e tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2" status: 200 len: 1296 microversion: 2.1 time: 0.088827 Jun 03 10:09:14.406366 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 577/1194] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:09:14 2022] GET /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2 => generated 1296 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:09:15.422243 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-d40ad28b-7829-45ff-9c9d-b2ba458c982d tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:09:15.422893 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-d40ad28b-7829-45ff-9c9d-b2ba458c982d tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: bd2900bc-2530-434e-906a-7edefd20e4b2] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:09:15.429458 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d40ad28b-7829-45ff-9c9d-b2ba458c982d tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:15.429942 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d40ad28b-7829-45ff-9c9d-b2ba458c982d tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:15.430702 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d40ad28b-7829-45ff-9c9d-b2ba458c982d tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:15.431134 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d40ad28b-7829-45ff-9c9d-b2ba458c982d tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:15.564518 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-d40ad28b-7829-45ff-9c9d-b2ba458c982d tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617a19a03f4941dd98022cf3f8397fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:09:15.573210 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-d40ad28b-7829-45ff-9c9d-b2ba458c982d tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2" status: 200 len: 1362 microversion: 2.1 time: 0.154816 Jun 03 10:09:15.575733 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 618/1195] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:09:15 2022] GET /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:09:15.834494 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-199f4338-cbd8-409b-8057-02ecee62c9be req-c40f2172-ddfe-4c36-9d54-106dfa267268 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd2900bc-2530-434e-906a-7edefd20e4b2", "tag": "c32d5215-e002-4058-8cf1-a1e66878df21"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:09:15.849657 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-199f4338-cbd8-409b-8057-02ecee62c9be req-c40f2172-ddfe-4c36-9d54-106dfa267268 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:15.850524 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-199f4338-cbd8-409b-8057-02ecee62c9be req-c40f2172-ddfe-4c36-9d54-106dfa267268 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:15.869308 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-199f4338-cbd8-409b-8057-02ecee62c9be req-c40f2172-ddfe-4c36-9d54-106dfa267268 service nova] Creating event network-changed:c32d5215-e002-4058-8cf1-a1e66878df21 for instance bd2900bc-2530-434e-906a-7edefd20e4b2 on hv-cinder-79760 Jun 03 10:09:15.875060 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-199f4338-cbd8-409b-8057-02ecee62c9be req-c40f2172-ddfe-4c36-9d54-106dfa267268 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044363 Jun 03 10:09:15.875662 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 578/1196] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:09:16.591583 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-14ee8c88-da2c-43d7-acb6-0970d2c05f5b tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:09:16.592199 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-14ee8c88-da2c-43d7-acb6-0970d2c05f5b tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: bd2900bc-2530-434e-906a-7edefd20e4b2] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:09:16.598797 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-14ee8c88-da2c-43d7-acb6-0970d2c05f5b tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:16.599250 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-14ee8c88-da2c-43d7-acb6-0970d2c05f5b tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:16.600016 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-14ee8c88-da2c-43d7-acb6-0970d2c05f5b tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:16.600457 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-14ee8c88-da2c-43d7-acb6-0970d2c05f5b tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:16.733142 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-14ee8c88-da2c-43d7-acb6-0970d2c05f5b tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617a19a03f4941dd98022cf3f8397fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:09:16.740598 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-14ee8c88-da2c-43d7-acb6-0970d2c05f5b tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2" status: 200 len: 1362 microversion: 2.1 time: 0.152846 Jun 03 10:09:16.741158 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 619/1197] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:09:16 2022] GET /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:09:17.757460 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-2f1b4cfc-2548-4bd4-bcbb-7217c0abdb14 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:09:17.758189 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-2f1b4cfc-2548-4bd4-bcbb-7217c0abdb14 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: bd2900bc-2530-434e-906a-7edefd20e4b2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:09:17.764302 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2f1b4cfc-2548-4bd4-bcbb-7217c0abdb14 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:17.764747 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2f1b4cfc-2548-4bd4-bcbb-7217c0abdb14 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:17.765501 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2f1b4cfc-2548-4bd4-bcbb-7217c0abdb14 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:17.765965 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-2f1b4cfc-2548-4bd4-bcbb-7217c0abdb14 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:17.891171 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-2f1b4cfc-2548-4bd4-bcbb-7217c0abdb14 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617a19a03f4941dd98022cf3f8397fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:09:17.898561 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-2f1b4cfc-2548-4bd4-bcbb-7217c0abdb14 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2" status: 200 len: 1362 microversion: 2.1 time: 0.145906 Jun 03 10:09:17.899118 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 579/1198] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:09:17 2022] GET /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2 => generated 1362 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:09:18.914942 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-b57d57e1-f5e0-4313-8735-559b8d202e35 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:09:18.915552 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-b57d57e1-f5e0-4313-8735-559b8d202e35 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: bd2900bc-2530-434e-906a-7edefd20e4b2] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:09:18.922152 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b57d57e1-f5e0-4313-8735-559b8d202e35 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:18.922599 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b57d57e1-f5e0-4313-8735-559b8d202e35 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:18.923356 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b57d57e1-f5e0-4313-8735-559b8d202e35 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:18.923793 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b57d57e1-f5e0-4313-8735-559b8d202e35 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:19.052253 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-b57d57e1-f5e0-4313-8735-559b8d202e35 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617a19a03f4941dd98022cf3f8397fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:09:19.060341 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-b57d57e1-f5e0-4313-8735-559b8d202e35 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2" status: 200 len: 1362 microversion: 2.1 time: 0.149541 Jun 03 10:09:19.060901 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 620/1199] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:09:18 2022] GET /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:09:20.078998 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-1220493b-dea8-43c3-8f13-540b81fef18e tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:09:20.079608 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-1220493b-dea8-43c3-8f13-540b81fef18e tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: bd2900bc-2530-434e-906a-7edefd20e4b2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:09:20.087508 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1220493b-dea8-43c3-8f13-540b81fef18e tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:20.087949 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1220493b-dea8-43c3-8f13-540b81fef18e tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:20.088719 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1220493b-dea8-43c3-8f13-540b81fef18e tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:20.089150 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1220493b-dea8-43c3-8f13-540b81fef18e tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:20.217067 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-1220493b-dea8-43c3-8f13-540b81fef18e tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617a19a03f4941dd98022cf3f8397fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:09:20.224368 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-1220493b-dea8-43c3-8f13-540b81fef18e tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2" status: 200 len: 1362 microversion: 2.1 time: 0.150567 Jun 03 10:09:20.224955 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 580/1200] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:09:20 2022] GET /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:09:21.241060 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-3d2e3cf0-a4e3-4296-adc8-bb2f40406155 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:09:21.241677 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-3d2e3cf0-a4e3-4296-adc8-bb2f40406155 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: bd2900bc-2530-434e-906a-7edefd20e4b2] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:09:21.247945 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3d2e3cf0-a4e3-4296-adc8-bb2f40406155 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:21.248401 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3d2e3cf0-a4e3-4296-adc8-bb2f40406155 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:21.249169 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3d2e3cf0-a4e3-4296-adc8-bb2f40406155 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:21.249612 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3d2e3cf0-a4e3-4296-adc8-bb2f40406155 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:21.379180 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-3d2e3cf0-a4e3-4296-adc8-bb2f40406155 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617a19a03f4941dd98022cf3f8397fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:09:21.387603 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-3d2e3cf0-a4e3-4296-adc8-bb2f40406155 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2" status: 200 len: 1362 microversion: 2.1 time: 0.150162 Jun 03 10:09:21.388573 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 621/1201] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:09:21 2022] GET /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:09:21.724241 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-f241075a-68c2-47b6-b60c-80c6a62ca6aa req-7ea73c26-99f2-4085-9490-1dd0a46cf0cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd2900bc-2530-434e-906a-7edefd20e4b2", "name": "network-vif-plugged", "status": "completed", "tag": "c32d5215-e002-4058-8cf1-a1e66878df21"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:09:21.732910 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-f241075a-68c2-47b6-b60c-80c6a62ca6aa req-7ea73c26-99f2-4085-9490-1dd0a46cf0cf service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:21.733378 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-f241075a-68c2-47b6-b60c-80c6a62ca6aa req-7ea73c26-99f2-4085-9490-1dd0a46cf0cf service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:21.744457 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-f241075a-68c2-47b6-b60c-80c6a62ca6aa req-7ea73c26-99f2-4085-9490-1dd0a46cf0cf service nova] Creating event network-vif-plugged:c32d5215-e002-4058-8cf1-a1e66878df21 for instance bd2900bc-2530-434e-906a-7edefd20e4b2 on hv-cinder-79760 Jun 03 10:09:21.749365 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-f241075a-68c2-47b6-b60c-80c6a62ca6aa req-7ea73c26-99f2-4085-9490-1dd0a46cf0cf service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147781 Jun 03 10:09:21.749966 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 581/1202] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:09:22.406398 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-ec3f0e2b-2f1c-4636-82a8-c163165609fb tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:09:22.407007 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-ec3f0e2b-2f1c-4636-82a8-c163165609fb tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: bd2900bc-2530-434e-906a-7edefd20e4b2] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:09:22.414257 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ec3f0e2b-2f1c-4636-82a8-c163165609fb tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:22.414698 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ec3f0e2b-2f1c-4636-82a8-c163165609fb tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:22.415451 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ec3f0e2b-2f1c-4636-82a8-c163165609fb tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:22.415876 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ec3f0e2b-2f1c-4636-82a8-c163165609fb tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:22.542033 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-ec3f0e2b-2f1c-4636-82a8-c163165609fb tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617a19a03f4941dd98022cf3f8397fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:09:22.549454 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-ec3f0e2b-2f1c-4636-82a8-c163165609fb tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2" status: 200 len: 1362 microversion: 2.1 time: 0.146902 Jun 03 10:09:22.550047 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 622/1203] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:09:22 2022] GET /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:09:23.564370 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell0:SELECT=2 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:09:23.565159 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell0:SELECT=6 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:09:23.569166 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-1a4a0de5-bd86-4a2e-8276-8070bec809a4 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:09:23.569931 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-1a4a0de5-bd86-4a2e-8276-8070bec809a4 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: bd2900bc-2530-434e-906a-7edefd20e4b2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:09:23.576985 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1a4a0de5-bd86-4a2e-8276-8070bec809a4 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:23.577427 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1a4a0de5-bd86-4a2e-8276-8070bec809a4 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:23.578404 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1a4a0de5-bd86-4a2e-8276-8070bec809a4 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:23.578862 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1a4a0de5-bd86-4a2e-8276-8070bec809a4 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:23.714651 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-1a4a0de5-bd86-4a2e-8276-8070bec809a4 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617a19a03f4941dd98022cf3f8397fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:09:23.722061 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-1a4a0de5-bd86-4a2e-8276-8070bec809a4 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2" status: 200 len: 1549 microversion: 2.1 time: 0.159038 Jun 03 10:09:23.722615 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 582/1204] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:09:23 2022] GET /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2 => generated 1549 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:09:23.738557 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-608e702d-3aa7-443d-8ddd-df09e3fd82b9 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:09:23.739050 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-608e702d-3aa7-443d-8ddd-df09e3fd82b9 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: bd2900bc-2530-434e-906a-7edefd20e4b2] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:09:23.741006 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell0:SELECT=6 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:09:23.747538 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-608e702d-3aa7-443d-8ddd-df09e3fd82b9 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:23.747991 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-608e702d-3aa7-443d-8ddd-df09e3fd82b9 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:23.748797 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-608e702d-3aa7-443d-8ddd-df09e3fd82b9 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:23.749239 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-608e702d-3aa7-443d-8ddd-df09e3fd82b9 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:23.824697 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-608e702d-3aa7-443d-8ddd-df09e3fd82b9 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089970 Jun 03 10:09:23.825285 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 623/1205] 10.222.0.45 () {58 vars in 1274 bytes} [Fri Jun 3 10:09:23 2022] GET /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:09:24.709706 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-e6b13885-b1ff-4efe-bb1d-98c9964b548e req-c0243da0-0b7a-4543-9fdd-d0d674fac0eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd2900bc-2530-434e-906a-7edefd20e4b2", "tag": "c32d5215-e002-4058-8cf1-a1e66878df21"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:09:24.718769 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-e6b13885-b1ff-4efe-bb1d-98c9964b548e req-c0243da0-0b7a-4543-9fdd-d0d674fac0eb service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:09:24.719218 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-e6b13885-b1ff-4efe-bb1d-98c9964b548e req-c0243da0-0b7a-4543-9fdd-d0d674fac0eb service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:09:24.731002 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-e6b13885-b1ff-4efe-bb1d-98c9964b548e req-c0243da0-0b7a-4543-9fdd-d0d674fac0eb service nova] Creating event network-changed:c32d5215-e002-4058-8cf1-a1e66878df21 for instance bd2900bc-2530-434e-906a-7edefd20e4b2 on hv-cinder-79760 Jun 03 10:09:24.735968 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-e6b13885-b1ff-4efe-bb1d-98c9964b548e req-c0243da0-0b7a-4543-9fdd-d0d674fac0eb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029907 Jun 03 10:09:24.736733 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 583/1206] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:10:00.518086 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:10:00.518878 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:10:00.522698 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-359eacb9-6f7d-4d5b-985c-c708ca541bc4 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:10:00.523181 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-359eacb9-6f7d-4d5b-985c-c708ca541bc4 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: bd2900bc-2530-434e-906a-7edefd20e4b2] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:10:00.530869 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-359eacb9-6f7d-4d5b-985c-c708ca541bc4 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:10:00.531296 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-359eacb9-6f7d-4d5b-985c-c708ca541bc4 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:10:00.532052 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-359eacb9-6f7d-4d5b-985c-c708ca541bc4 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:10:00.532483 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-359eacb9-6f7d-4d5b-985c-c708ca541bc4 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:10:00.556669 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-359eacb9-6f7d-4d5b-985c-c708ca541bc4 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2/ips" status: 200 len: 146 microversion: 2.1 time: 0.040072 Jun 03 10:10:00.557229 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 624/1207] 10.222.0.45 () {58 vars in 1247 bytes} [Fri Jun 3 10:10:00 2022] GET /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2/ips => generated 146 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:10:01.871114 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-55cacd10-de67-4d26-9921-1631416af3c6 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "685285e8-cdaa-4c68-bddd-30f827bdb1ba"}} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:10:01.872262 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-55cacd10-de67-4d26-9921-1631416af3c6 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: bd2900bc-2530-434e-906a-7edefd20e4b2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:10:01.874512 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_api:SELECT=42,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:10:01.875151 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell1:SELECT=58 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:10:01.882078 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-55cacd10-de67-4d26-9921-1631416af3c6 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:10:01.882606 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-55cacd10-de67-4d26-9921-1631416af3c6 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:10:01.883377 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-55cacd10-de67-4d26-9921-1631416af3c6 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:10:01.883816 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-55cacd10-de67-4d26-9921-1631416af3c6 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:10:02.146130 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-55cacd10-de67-4d26-9921-1631416af3c6 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "POST /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279807 Jun 03 10:10:02.148178 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 584/1208] 10.222.0.45 () {60 vars in 1322 bytes} [Fri Jun 3 10:10:01 2022] POST /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2/os-volume_attachments => generated 194 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:10:09.624096 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-55f282dd-15cc-49b0-b014-fad2570a15b6 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:10:09.625025 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-55f282dd-15cc-49b0-b014-fad2570a15b6 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: bd2900bc-2530-434e-906a-7edefd20e4b2] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:10:09.631507 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-55f282dd-15cc-49b0-b014-fad2570a15b6 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:10:09.631962 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-55f282dd-15cc-49b0-b014-fad2570a15b6 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:10:09.632727 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-55f282dd-15cc-49b0-b014-fad2570a15b6 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:10:09.633164 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-55f282dd-15cc-49b0-b014-fad2570a15b6 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:10:09.662155 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-55f282dd-15cc-49b0-b014-fad2570a15b6 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041826 Jun 03 10:10:09.662633 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 625/1209] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 3 10:10:09 2022] GET /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:10:09.673479 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-d31b8006-4908-4546-9b41-72b423562004 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:10:09.674115 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-d31b8006-4908-4546-9b41-72b423562004 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: bd2900bc-2530-434e-906a-7edefd20e4b2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:10:09.680459 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d31b8006-4908-4546-9b41-72b423562004 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:10:09.680917 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d31b8006-4908-4546-9b41-72b423562004 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:10:09.681683 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d31b8006-4908-4546-9b41-72b423562004 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:10:09.682152 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-d31b8006-4908-4546-9b41-72b423562004 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:10:09.709732 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-d31b8006-4908-4546-9b41-72b423562004 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2/os-volume_attachments/685285e8-cdaa-4c68-bddd-30f827bdb1ba" status: 200 len: 194 microversion: 2.1 time: 0.041002 Jun 03 10:10:09.710318 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 585/1210] 10.222.0.45 () {58 vars in 1412 bytes} [Fri Jun 3 10:10:09 2022] GET /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2/os-volume_attachments/685285e8-cdaa-4c68-bddd-30f827bdb1ba => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:10:11.024000 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-b207aaee-779e-4736-9f08-9821b881433f tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9088c47d-1de7-418a-95fc-b9fe36d5ff6e"}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:10:11.025087 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-b207aaee-779e-4736-9f08-9821b881433f tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: bd2900bc-2530-434e-906a-7edefd20e4b2] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:10:11.032187 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b207aaee-779e-4736-9f08-9821b881433f tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:10:11.032630 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b207aaee-779e-4736-9f08-9821b881433f tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:10:11.033384 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b207aaee-779e-4736-9f08-9821b881433f tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:10:11.033836 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-b207aaee-779e-4736-9f08-9821b881433f tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:10:11.291754 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-b207aaee-779e-4736-9f08-9821b881433f tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "POST /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271548 Jun 03 10:10:11.292414 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 626/1211] 10.222.0.45 () {60 vars in 1322 bytes} [Fri Jun 3 10:10:11 2022] POST /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:10:18.777497 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-e95186ae-8951-40cd-9de3-c11e9bf9ca22 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:10:18.779948 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-e95186ae-8951-40cd-9de3-c11e9bf9ca22 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: bd2900bc-2530-434e-906a-7edefd20e4b2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:10:18.788552 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e95186ae-8951-40cd-9de3-c11e9bf9ca22 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:10:18.788998 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e95186ae-8951-40cd-9de3-c11e9bf9ca22 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:10:18.789766 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e95186ae-8951-40cd-9de3-c11e9bf9ca22 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:10:18.790210 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e95186ae-8951-40cd-9de3-c11e9bf9ca22 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:10:18.818446 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-e95186ae-8951-40cd-9de3-c11e9bf9ca22 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048329 Jun 03 10:10:18.818992 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 586/1212] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 3 10:10:18 2022] GET /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 10:10:18.958660 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-8af9d0e2-fcd3-46bf-99a2-7dee1b826894 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:10:18.959250 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-8af9d0e2-fcd3-46bf-99a2-7dee1b826894 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: bd2900bc-2530-434e-906a-7edefd20e4b2] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:10:18.965485 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8af9d0e2-fcd3-46bf-99a2-7dee1b826894 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:10:18.965973 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8af9d0e2-fcd3-46bf-99a2-7dee1b826894 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:10:18.966724 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8af9d0e2-fcd3-46bf-99a2-7dee1b826894 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:10:18.967155 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-8af9d0e2-fcd3-46bf-99a2-7dee1b826894 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:10:18.998225 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-8af9d0e2-fcd3-46bf-99a2-7dee1b826894 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2/os-volume_attachments/685285e8-cdaa-4c68-bddd-30f827bdb1ba" status: 200 len: 194 microversion: 2.1 time: 0.044174 Jun 03 10:10:18.998891 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 627/1213] 10.222.0.45 () {58 vars in 1412 bytes} [Fri Jun 3 10:10:18 2022] GET /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2/os-volume_attachments/685285e8-cdaa-4c68-bddd-30f827bdb1ba => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:10:19.008424 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-143da522-cbbb-4ba9-b364-a40b8d31b47a tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:10:19.008915 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-143da522-cbbb-4ba9-b364-a40b8d31b47a tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: bd2900bc-2530-434e-906a-7edefd20e4b2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:10:19.015533 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-143da522-cbbb-4ba9-b364-a40b8d31b47a tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:10:19.015972 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-143da522-cbbb-4ba9-b364-a40b8d31b47a tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:10:19.016724 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-143da522-cbbb-4ba9-b364-a40b8d31b47a tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:10:19.017150 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-143da522-cbbb-4ba9-b364-a40b8d31b47a tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:10:19.095531 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.objects.instance [None req-143da522-cbbb-4ba9-b364-a40b8d31b47a tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lazy-loading 'services' on Instance uuid bd2900bc-2530-434e-906a-7edefd20e4b2 {{(pid=117648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:10:19.164717 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-143da522-cbbb-4ba9-b364-a40b8d31b47a tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "DELETE /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2/os-volume_attachments/685285e8-cdaa-4c68-bddd-30f827bdb1ba" status: 202 len: 0 microversion: 2.1 time: 0.159938 Jun 03 10:10:19.165289 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 587/1214] 10.222.0.45 () {58 vars in 1415 bytes} [Fri Jun 3 10:10:19 2022] DELETE /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2/os-volume_attachments/685285e8-cdaa-4c68-bddd-30f827bdb1ba => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 10:10:20.274447 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-9383eadd-7201-4c4a-b20a-03a384b466e7 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:10:20.274969 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-9383eadd-7201-4c4a-b20a-03a384b466e7 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: bd2900bc-2530-434e-906a-7edefd20e4b2] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:10:20.282158 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9383eadd-7201-4c4a-b20a-03a384b466e7 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:10:20.282606 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9383eadd-7201-4c4a-b20a-03a384b466e7 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:10:20.283365 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9383eadd-7201-4c4a-b20a-03a384b466e7 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:10:20.283800 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9383eadd-7201-4c4a-b20a-03a384b466e7 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:10:20.313120 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-9383eadd-7201-4c4a-b20a-03a384b466e7 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2/os-volume_attachments/9088c47d-1de7-418a-95fc-b9fe36d5ff6e" status: 200 len: 194 microversion: 2.1 time: 0.042576 Jun 03 10:10:20.313703 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 628/1215] 10.222.0.45 () {58 vars in 1412 bytes} [Fri Jun 3 10:10:20 2022] GET /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2/os-volume_attachments/9088c47d-1de7-418a-95fc-b9fe36d5ff6e => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:10:20.324338 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-a9866a4a-aabf-463d-a23a-d8d2c0da5054 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:10:20.324928 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-a9866a4a-aabf-463d-a23a-d8d2c0da5054 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: bd2900bc-2530-434e-906a-7edefd20e4b2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:10:20.331780 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a9866a4a-aabf-463d-a23a-d8d2c0da5054 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:10:20.332234 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a9866a4a-aabf-463d-a23a-d8d2c0da5054 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:10:20.333001 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a9866a4a-aabf-463d-a23a-d8d2c0da5054 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:10:20.333442 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a9866a4a-aabf-463d-a23a-d8d2c0da5054 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:10:20.417809 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.objects.instance [None req-a9866a4a-aabf-463d-a23a-d8d2c0da5054 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lazy-loading 'services' on Instance uuid bd2900bc-2530-434e-906a-7edefd20e4b2 {{(pid=117648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:10:20.488436 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-a9866a4a-aabf-463d-a23a-d8d2c0da5054 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "DELETE /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2/os-volume_attachments/9088c47d-1de7-418a-95fc-b9fe36d5ff6e" status: 202 len: 0 microversion: 2.1 time: 0.168645 Jun 03 10:10:20.489011 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 588/1216] 10.222.0.45 () {58 vars in 1415 bytes} [Fri Jun 3 10:10:20 2022] DELETE /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2/os-volume_attachments/9088c47d-1de7-418a-95fc-b9fe36d5ff6e => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 10:10:21.645193 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-37c0ab94-6d23-46a3-b138-77ceff80f5c4 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:10:21.646219 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-37c0ab94-6d23-46a3-b138-77ceff80f5c4 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: bd2900bc-2530-434e-906a-7edefd20e4b2] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:10:21.652742 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-37c0ab94-6d23-46a3-b138-77ceff80f5c4 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:10:21.654050 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-37c0ab94-6d23-46a3-b138-77ceff80f5c4 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:10:21.654718 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-37c0ab94-6d23-46a3-b138-77ceff80f5c4 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:10:21.658750 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-37c0ab94-6d23-46a3-b138-77ceff80f5c4 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:10:21.684886 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-37c0ab94-6d23-46a3-b138-77ceff80f5c4 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043530 Jun 03 10:10:21.685443 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 629/1217] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 3 10:10:21 2022] GET /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 10:10:21.788085 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-4ae3461e-f553-43c2-a5ad-9d360df3fbaf tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:10:21.789358 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-4ae3461e-f553-43c2-a5ad-9d360df3fbaf tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: bd2900bc-2530-434e-906a-7edefd20e4b2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:10:21.796046 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4ae3461e-f553-43c2-a5ad-9d360df3fbaf tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:10:21.796489 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4ae3461e-f553-43c2-a5ad-9d360df3fbaf tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:10:21.797243 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4ae3461e-f553-43c2-a5ad-9d360df3fbaf tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:10:21.797670 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4ae3461e-f553-43c2-a5ad-9d360df3fbaf tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:10:21.827039 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-4ae3461e-f553-43c2-a5ad-9d360df3fbaf tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043472 Jun 03 10:10:21.827581 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 589/1218] 10.222.0.45 () {58 vars in 1301 bytes} [Fri Jun 3 10:10:21 2022] GET /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 03 10:10:21.883037 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-6f97987c-1607-4f22-84b6-03c34f5c942a tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:10:21.883526 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-6f97987c-1607-4f22-84b6-03c34f5c942a tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: bd2900bc-2530-434e-906a-7edefd20e4b2] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:10:21.890159 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6f97987c-1607-4f22-84b6-03c34f5c942a tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:10:21.890612 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6f97987c-1607-4f22-84b6-03c34f5c942a tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:10:21.891361 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6f97987c-1607-4f22-84b6-03c34f5c942a tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:10:21.891794 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-6f97987c-1607-4f22-84b6-03c34f5c942a tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:10:21.915529 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-6f97987c-1607-4f22-84b6-03c34f5c942a tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: bd2900bc-2530-434e-906a-7edefd20e4b2] Going to try to terminate instance {{(pid=117647) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 10:10:21.986745 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-6f97987c-1607-4f22-84b6-03c34f5c942a tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "DELETE /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2" status: 204 len: 0 microversion: 2.1 time: 0.107233 Jun 03 10:10:21.987328 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 630/1219] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jun 3 10:10:21 2022] DELETE /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 10:10:21.995824 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-f723e489-f40b-48ba-958a-1e6b14a46087 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:10:21.996446 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-f723e489-f40b-48ba-958a-1e6b14a46087 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: bd2900bc-2530-434e-906a-7edefd20e4b2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:10:22.003064 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f723e489-f40b-48ba-958a-1e6b14a46087 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:10:22.003519 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f723e489-f40b-48ba-958a-1e6b14a46087 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:10:22.004291 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f723e489-f40b-48ba-958a-1e6b14a46087 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:10:22.004730 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f723e489-f40b-48ba-958a-1e6b14a46087 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:10:22.138735 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-f723e489-f40b-48ba-958a-1e6b14a46087 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617a19a03f4941dd98022cf3f8397fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:10:22.146232 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-f723e489-f40b-48ba-958a-1e6b14a46087 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2" status: 200 len: 1673 microversion: 2.1 time: 0.154221 Jun 03 10:10:22.146798 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 590/1220] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:10:21 2022] GET /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2 => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:10:23.164224 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-27f44172-f820-4b1c-8538-eddf2e1652e3 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:10:23.164852 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-27f44172-f820-4b1c-8538-eddf2e1652e3 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: bd2900bc-2530-434e-906a-7edefd20e4b2] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:10:23.171310 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-27f44172-f820-4b1c-8538-eddf2e1652e3 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:10:23.171763 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-27f44172-f820-4b1c-8538-eddf2e1652e3 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:10:23.172533 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-27f44172-f820-4b1c-8538-eddf2e1652e3 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:10:23.172973 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-27f44172-f820-4b1c-8538-eddf2e1652e3 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:10:23.299490 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-27f44172-f820-4b1c-8538-eddf2e1652e3 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617a19a03f4941dd98022cf3f8397fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:10:23.306977 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-27f44172-f820-4b1c-8538-eddf2e1652e3 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2" status: 200 len: 1673 microversion: 2.1 time: 0.147347 Jun 03 10:10:23.307546 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 631/1221] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:10:23 2022] GET /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2 => generated 1673 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:10:24.323879 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-59ef808e-699d-4c46-9ab3-a707996f2dcb tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:10:24.324486 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-59ef808e-699d-4c46-9ab3-a707996f2dcb tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: bd2900bc-2530-434e-906a-7edefd20e4b2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:10:24.330913 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-59ef808e-699d-4c46-9ab3-a707996f2dcb tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:10:24.331355 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-59ef808e-699d-4c46-9ab3-a707996f2dcb tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:10:24.332116 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-59ef808e-699d-4c46-9ab3-a707996f2dcb tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:10:24.332546 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-59ef808e-699d-4c46-9ab3-a707996f2dcb tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:10:24.463752 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-59ef808e-699d-4c46-9ab3-a707996f2dcb tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617a19a03f4941dd98022cf3f8397fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:10:24.471869 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-59ef808e-699d-4c46-9ab3-a707996f2dcb tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2" status: 200 len: 1673 microversion: 2.1 time: 0.151785 Jun 03 10:10:24.472480 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 591/1222] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:10:24 2022] GET /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2 => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:10:25.131507 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-43e5be1a-1ea7-4654-bac3-6ae708b95da8 req-d7a51f9b-aa78-4ab6-82a3-347e5ec6659b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd2900bc-2530-434e-906a-7edefd20e4b2", "name": "network-vif-deleted", "tag": "c32d5215-e002-4058-8cf1-a1e66878df21"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:10:25.140989 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-43e5be1a-1ea7-4654-bac3-6ae708b95da8 req-d7a51f9b-aa78-4ab6-82a3-347e5ec6659b service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:10:25.141449 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-43e5be1a-1ea7-4654-bac3-6ae708b95da8 req-d7a51f9b-aa78-4ab6-82a3-347e5ec6659b service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:10:25.152639 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-43e5be1a-1ea7-4654-bac3-6ae708b95da8 req-d7a51f9b-aa78-4ab6-82a3-347e5ec6659b service nova] Creating event network-vif-deleted:c32d5215-e002-4058-8cf1-a1e66878df21 for instance bd2900bc-2530-434e-906a-7edefd20e4b2 on hv-cinder-79760 Jun 03 10:10:25.157455 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-43e5be1a-1ea7-4654-bac3-6ae708b95da8 req-d7a51f9b-aa78-4ab6-82a3-347e5ec6659b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029566 Jun 03 10:10:25.160999 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 632/1223] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:10:25.488635 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-bd4af1b1-a5b8-412a-a0ed-37f629273568 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:10:25.489909 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-bd4af1b1-a5b8-412a-a0ed-37f629273568 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: bd2900bc-2530-434e-906a-7edefd20e4b2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:10:25.497454 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-bd4af1b1-a5b8-412a-a0ed-37f629273568 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:10:25.497927 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-bd4af1b1-a5b8-412a-a0ed-37f629273568 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:10:25.498755 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-bd4af1b1-a5b8-412a-a0ed-37f629273568 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:10:25.499188 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-bd4af1b1-a5b8-412a-a0ed-37f629273568 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:10:25.531027 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-bd4af1b1-a5b8-412a-a0ed-37f629273568 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:10:25.531838 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-bd4af1b1-a5b8-412a-a0ed-37f629273568 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:10:25.532605 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.objects.instance [None req-bd4af1b1-a5b8-412a-a0ed-37f629273568 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lazy-loading 'fault' on Instance uuid bd2900bc-2530-434e-906a-7edefd20e4b2 {{(pid=117648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:10:25.577265 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-bd4af1b1-a5b8-412a-a0ed-37f629273568 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '617a19a03f4941dd98022cf3f8397fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02a9ee05c1ee47e08b2f7c1601dda3c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:10:25.590108 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-bd4af1b1-a5b8-412a-a0ed-37f629273568 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2" status: 200 len: 1326 microversion: 2.1 time: 0.105040 Jun 03 10:10:25.591255 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 592/1224] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:10:25 2022] GET /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2 => generated 1326 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:10:26.608535 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-2dd913f7-c069-4605-9bb2-bb58a62bb466 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:10:26.609241 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-2dd913f7-c069-4605-9bb2-bb58a62bb466 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: bd2900bc-2530-434e-906a-7edefd20e4b2] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:10:26.615467 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2dd913f7-c069-4605-9bb2-bb58a62bb466 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:10:26.615916 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2dd913f7-c069-4605-9bb2-bb58a62bb466 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:10:26.616676 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2dd913f7-c069-4605-9bb2-bb58a62bb466 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:10:26.617108 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2dd913f7-c069-4605-9bb2-bb58a62bb466 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:10:26.629951 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.wsgi [None req-2dd913f7-c069-4605-9bb2-bb58a62bb466 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] HTTP exception thrown: Instance bd2900bc-2530-434e-906a-7edefd20e4b2 could not be found. Jun 03 10:10:26.631528 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-2dd913f7-c069-4605-9bb2-bb58a62bb466 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Request method failure captured: Jun 03 10:10:26.631528 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: request: GET /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2 HTTP/1.1 Jun 03 10:10:26.631528 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Accept: application/json Jun 03 10:10:26.631528 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Accept-Encoding: identity Jun 03 10:10:26.631528 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Connection: close Jun 03 10:10:26.631528 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Content-Length: 0 Jun 03 10:10:26.631528 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Content-Type: application/json Jun 03 10:10:26.631528 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Host: 10.222.0.45 Jun 03 10:10:26.631528 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Openstack-System-Scope: None Jun 03 10:10:26.631528 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: User-Agent: python-urllib3/1.26.9 Jun 03 10:10:26.631528 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Auth-Token: gAAAAABimd0c1bQwAMqoi7wOOUGvnF9O4UjSjRQHEkE5OW6dW4Bw9TsHKmezt1mMLiJlWU37Wa_QT7dcGsr104zApmGUxqR3tA_EDsbS0ZfT_2dokn2piNFrjkFG8BqminbczBFSewlGIcNfJbg3ayAM-9tMPQGUQuEGLxFxCBJeVnaARNwHUPw Jun 03 10:10:26.631528 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Domain-Id: None Jun 03 10:10:26.631528 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Domain-Name: None Jun 03 10:10:26.631528 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Identity-Status: Confirmed Jun 03 10:10:26.631528 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Is-Admin-Project: True Jun 03 10:10:26.631528 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Domain-Id: default Jun 03 10:10:26.631528 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Domain-Name: Default Jun 03 10:10:26.631528 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Id: 02a9ee05c1ee47e08b2f7c1601dda3c2 Jun 03 10:10:26.631528 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Name: tempest-AttachVolumeTestJSON-623627224 Jun 03 10:10:26.631528 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Role: member,reader Jun 03 10:10:26.631528 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Roles: member,reader Jun 03 10:10:26.633235 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_02a9ee05c1ee47e08b2f7c1601dda3c2", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/02a9ee05c1ee47e08b2f7c1601dda3c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/02a9ee05c1ee47e08b2f7c1601dda3c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/02a9ee05c1ee47e08b2f7c1601dda3c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 10:10:26.633235 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant: tempest-AttachVolumeTestJSON-623627224 Jun 03 10:10:26.633235 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant-Id: 02a9ee05c1ee47e08b2f7c1601dda3c2 Jun 03 10:10:26.633235 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant-Name: tempest-AttachVolumeTestJSON-623627224 Jun 03 10:10:26.633235 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User: tempest-AttachVolumeTestJSON-623627224-project Jun 03 10:10:26.633235 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Domain-Id: default Jun 03 10:10:26.633235 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Domain-Name: Default Jun 03 10:10:26.633235 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Id: 617a19a03f4941dd98022cf3f8397fef Jun 03 10:10:26.633235 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Name: tempest-AttachVolumeTestJSON-623627224-project Jun 03 10:10:26.633235 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: method: > Jun 03 10:10:26.633235 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: exception: Instance bd2900bc-2530-434e-906a-7edefd20e4b2 could not be found. Jun 03 10:10:26.633235 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: action_args: {'id': 'bd2900bc-2530-434e-906a-7edefd20e4b2'} Jun 03 10:10:26.634502 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:10:26.634502 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:10:26.634502 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:10:26.634502 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:10:26.634502 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:10:26.634502 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:10:26.634502 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:10:26.634502 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:10:26.634502 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:10:26.634502 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:10:26.634502 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd2900bc-2530-434e-906a-7edefd20e4b2 could not be found. Jun 03 10:10:26.634502 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:10:26.634502 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:10:26.634502 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:10:26.634502 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:10:26.634502 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:10:26.634502 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:10:26.634502 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:10:26.634502 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:10:26.634502 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:10:26.636103 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:10:26.636103 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:10:26.636103 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:10:26.636103 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:10:26.636103 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:10:26.636103 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:10:26.636103 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:10:26.636103 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd2900bc-2530-434e-906a-7edefd20e4b2 could not be found. Jun 03 10:10:26.636103 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:10:26.636103 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:10:26.636103 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:10:26.636103 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:10:26.636103 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:10:26.636103 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:10:26.636103 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:10:26.636103 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:10:26.636103 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd2900bc-2530-434e-906a-7edefd20e4b2 could not be found. Jun 03 10:10:26.636103 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:10:26.637732 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-2dd913f7-c069-4605-9bb2-bb58a62bb466 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Returning 404 to user: Instance bd2900bc-2530-434e-906a-7edefd20e4b2 could not be found. {{(pid=117647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:10:26.637732 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-2dd913f7-c069-4605-9bb2-bb58a62bb466 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2" status: 404 len: 111 microversion: 2.1 time: 0.029789 Jun 03 10:10:26.637732 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 633/1225] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:10:26 2022] GET /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 10:10:26.641528 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-31667e78-9e29-4b3d-9fd3-776a35dddb76 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '.version_select at 0x7f5036ab7a60>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:10:26.659267 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-31667e78-9e29-4b3d-9fd3-776a35dddb76 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1918363024" status: 202 len: 0 microversion: 2.1 time: 0.021436 Jun 03 10:10:26.659750 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 593/1226] 10.222.0.45 () {58 vars in 1220 bytes} [Fri Jun 3 10:10:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1918363024 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 03 10:10:29.508130 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-378b7169-21c4-4045-81ef-c8ec6a107a7d tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:10:29.508630 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-378b7169-21c4-4045-81ef-c8ec6a107a7d tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: bd2900bc-2530-434e-906a-7edefd20e4b2] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:10:29.515093 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-378b7169-21c4-4045-81ef-c8ec6a107a7d tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:10:29.515536 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-378b7169-21c4-4045-81ef-c8ec6a107a7d tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:10:29.516292 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-378b7169-21c4-4045-81ef-c8ec6a107a7d tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:10:29.516726 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-378b7169-21c4-4045-81ef-c8ec6a107a7d tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:10:29.531968 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.wsgi [None req-378b7169-21c4-4045-81ef-c8ec6a107a7d tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] HTTP exception thrown: Instance bd2900bc-2530-434e-906a-7edefd20e4b2 could not be found. Jun 03 10:10:29.533483 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-378b7169-21c4-4045-81ef-c8ec6a107a7d tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Request method failure captured: Jun 03 10:10:29.533483 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: request: DELETE /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2 HTTP/1.1 Jun 03 10:10:29.533483 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Accept: application/json Jun 03 10:10:29.533483 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Accept-Encoding: identity Jun 03 10:10:29.533483 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Connection: close Jun 03 10:10:29.533483 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Content-Length: 0 Jun 03 10:10:29.533483 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Content-Type: application/json Jun 03 10:10:29.533483 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Host: 10.222.0.45 Jun 03 10:10:29.533483 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Openstack-System-Scope: None Jun 03 10:10:29.533483 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: User-Agent: python-urllib3/1.26.9 Jun 03 10:10:29.533483 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Auth-Token: gAAAAABimd0c1bQwAMqoi7wOOUGvnF9O4UjSjRQHEkE5OW6dW4Bw9TsHKmezt1mMLiJlWU37Wa_QT7dcGsr104zApmGUxqR3tA_EDsbS0ZfT_2dokn2piNFrjkFG8BqminbczBFSewlGIcNfJbg3ayAM-9tMPQGUQuEGLxFxCBJeVnaARNwHUPw Jun 03 10:10:29.533483 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Domain-Id: None Jun 03 10:10:29.533483 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Domain-Name: None Jun 03 10:10:29.533483 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Identity-Status: Confirmed Jun 03 10:10:29.533483 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Is-Admin-Project: True Jun 03 10:10:29.533483 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Domain-Id: default Jun 03 10:10:29.533483 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Domain-Name: Default Jun 03 10:10:29.533483 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Id: 02a9ee05c1ee47e08b2f7c1601dda3c2 Jun 03 10:10:29.533483 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Name: tempest-AttachVolumeTestJSON-623627224 Jun 03 10:10:29.533483 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Role: member,reader Jun 03 10:10:29.533483 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Roles: member,reader Jun 03 10:10:29.535135 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_02a9ee05c1ee47e08b2f7c1601dda3c2", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/02a9ee05c1ee47e08b2f7c1601dda3c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/02a9ee05c1ee47e08b2f7c1601dda3c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/02a9ee05c1ee47e08b2f7c1601dda3c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 10:10:29.535135 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant: tempest-AttachVolumeTestJSON-623627224 Jun 03 10:10:29.535135 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant-Id: 02a9ee05c1ee47e08b2f7c1601dda3c2 Jun 03 10:10:29.535135 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant-Name: tempest-AttachVolumeTestJSON-623627224 Jun 03 10:10:29.535135 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User: tempest-AttachVolumeTestJSON-623627224-project Jun 03 10:10:29.535135 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Domain-Id: default Jun 03 10:10:29.535135 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Domain-Name: Default Jun 03 10:10:29.535135 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Id: 617a19a03f4941dd98022cf3f8397fef Jun 03 10:10:29.535135 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Name: tempest-AttachVolumeTestJSON-623627224-project Jun 03 10:10:29.535135 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: method: > Jun 03 10:10:29.535135 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: exception: Instance bd2900bc-2530-434e-906a-7edefd20e4b2 could not be found. Jun 03 10:10:29.535135 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: action_args: {'id': 'bd2900bc-2530-434e-906a-7edefd20e4b2'} Jun 03 10:10:29.536076 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:10:29.536076 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:10:29.536076 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:10:29.536076 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:10:29.536076 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:10:29.536076 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:10:29.536076 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:10:29.536076 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:10:29.536076 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:10:29.536076 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:10:29.536076 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd2900bc-2530-434e-906a-7edefd20e4b2 could not be found. Jun 03 10:10:29.536076 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:10:29.536076 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:10:29.536076 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:10:29.536076 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:10:29.536076 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:10:29.536076 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:10:29.536076 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:10:29.536076 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:10:29.536076 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:10:29.537606 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:10:29.537606 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 10:10:29.537606 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 10:10:29.537606 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 10:10:29.537606 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 10:10:29.537606 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:10:29.537606 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:10:29.537606 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:10:29.537606 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:10:29.537606 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd2900bc-2530-434e-906a-7edefd20e4b2 could not be found. Jun 03 10:10:29.537606 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:10:29.537606 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:10:29.537606 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:10:29.537606 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:10:29.537606 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:10:29.537606 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:10:29.537606 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:10:29.537606 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:10:29.537606 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd2900bc-2530-434e-906a-7edefd20e4b2 could not be found. Jun 03 10:10:29.537606 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:10:29.539666 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-378b7169-21c4-4045-81ef-c8ec6a107a7d tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Returning 404 to user: Instance bd2900bc-2530-434e-906a-7edefd20e4b2 could not be found. {{(pid=117647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:10:29.539666 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-378b7169-21c4-4045-81ef-c8ec6a107a7d tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "DELETE /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2" status: 404 len: 111 microversion: 2.1 time: 0.030596 Jun 03 10:10:29.539666 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 634/1227] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jun 3 10:10:29 2022] DELETE /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 10:10:29.543453 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-158eaba3-16af-4675-b9bb-6b42d79fb654 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:10:29.544657 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-158eaba3-16af-4675-b9bb-6b42d79fb654 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: bd2900bc-2530-434e-906a-7edefd20e4b2] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:10:29.551963 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-158eaba3-16af-4675-b9bb-6b42d79fb654 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:10:29.552563 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-158eaba3-16af-4675-b9bb-6b42d79fb654 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:10:29.553334 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-158eaba3-16af-4675-b9bb-6b42d79fb654 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:10:29.553807 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-158eaba3-16af-4675-b9bb-6b42d79fb654 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:10:29.566781 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.wsgi [None req-158eaba3-16af-4675-b9bb-6b42d79fb654 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] HTTP exception thrown: Instance bd2900bc-2530-434e-906a-7edefd20e4b2 could not be found. Jun 03 10:10:29.568400 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-158eaba3-16af-4675-b9bb-6b42d79fb654 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Request method failure captured: Jun 03 10:10:29.568400 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: request: GET /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2 HTTP/1.1 Jun 03 10:10:29.568400 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept: application/json Jun 03 10:10:29.568400 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept-Encoding: identity Jun 03 10:10:29.568400 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Connection: close Jun 03 10:10:29.568400 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Length: 0 Jun 03 10:10:29.568400 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Type: application/json Jun 03 10:10:29.568400 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Host: 10.222.0.45 Jun 03 10:10:29.568400 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Openstack-System-Scope: None Jun 03 10:10:29.568400 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: User-Agent: python-urllib3/1.26.9 Jun 03 10:10:29.568400 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Auth-Token: gAAAAABimd0c1bQwAMqoi7wOOUGvnF9O4UjSjRQHEkE5OW6dW4Bw9TsHKmezt1mMLiJlWU37Wa_QT7dcGsr104zApmGUxqR3tA_EDsbS0ZfT_2dokn2piNFrjkFG8BqminbczBFSewlGIcNfJbg3ayAM-9tMPQGUQuEGLxFxCBJeVnaARNwHUPw Jun 03 10:10:29.568400 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Id: None Jun 03 10:10:29.568400 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Name: None Jun 03 10:10:29.568400 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Identity-Status: Confirmed Jun 03 10:10:29.568400 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Is-Admin-Project: True Jun 03 10:10:29.568400 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Id: default Jun 03 10:10:29.568400 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Name: Default Jun 03 10:10:29.568400 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Id: 02a9ee05c1ee47e08b2f7c1601dda3c2 Jun 03 10:10:29.568400 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Name: tempest-AttachVolumeTestJSON-623627224 Jun 03 10:10:29.568400 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Role: member,reader Jun 03 10:10:29.568400 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Roles: member,reader Jun 03 10:10:29.570051 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_02a9ee05c1ee47e08b2f7c1601dda3c2", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/02a9ee05c1ee47e08b2f7c1601dda3c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/02a9ee05c1ee47e08b2f7c1601dda3c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/02a9ee05c1ee47e08b2f7c1601dda3c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 10:10:29.570051 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant: tempest-AttachVolumeTestJSON-623627224 Jun 03 10:10:29.570051 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Id: 02a9ee05c1ee47e08b2f7c1601dda3c2 Jun 03 10:10:29.570051 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Name: tempest-AttachVolumeTestJSON-623627224 Jun 03 10:10:29.570051 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User: tempest-AttachVolumeTestJSON-623627224-project Jun 03 10:10:29.570051 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Id: default Jun 03 10:10:29.570051 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Name: Default Jun 03 10:10:29.570051 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Id: 617a19a03f4941dd98022cf3f8397fef Jun 03 10:10:29.570051 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Name: tempest-AttachVolumeTestJSON-623627224-project Jun 03 10:10:29.570051 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: method: > Jun 03 10:10:29.570051 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: exception: Instance bd2900bc-2530-434e-906a-7edefd20e4b2 could not be found. Jun 03 10:10:29.570051 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: action_args: {'id': 'bd2900bc-2530-434e-906a-7edefd20e4b2'} Jun 03 10:10:29.570916 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:10:29.570916 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:10:29.570916 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:10:29.570916 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:10:29.570916 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:10:29.570916 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:10:29.570916 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:10:29.570916 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:10:29.570916 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:10:29.570916 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:10:29.570916 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd2900bc-2530-434e-906a-7edefd20e4b2 could not be found. Jun 03 10:10:29.570916 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:10:29.570916 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:10:29.570916 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:10:29.570916 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:10:29.570916 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:10:29.570916 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:10:29.570916 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:10:29.570916 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:10:29.570916 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:10:29.572192 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:10:29.572192 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:10:29.572192 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:10:29.572192 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:10:29.572192 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:10:29.572192 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:10:29.572192 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:10:29.572192 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd2900bc-2530-434e-906a-7edefd20e4b2 could not be found. Jun 03 10:10:29.572192 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:10:29.572192 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:10:29.572192 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:10:29.572192 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:10:29.572192 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:10:29.572192 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:10:29.572192 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:10:29.572192 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:10:29.572192 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd2900bc-2530-434e-906a-7edefd20e4b2 could not be found. Jun 03 10:10:29.572192 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:10:29.573334 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-158eaba3-16af-4675-b9bb-6b42d79fb654 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Returning 404 to user: Instance bd2900bc-2530-434e-906a-7edefd20e4b2 could not be found. {{(pid=117648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:10:29.573334 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-158eaba3-16af-4675-b9bb-6b42d79fb654 tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2" status: 404 len: 111 microversion: 2.1 time: 0.030166 Jun 03 10:10:29.573334 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 594/1228] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:10:29 2022] GET /compute/v2.1/servers/bd2900bc-2530-434e-906a-7edefd20e4b2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 10:10:30.703472 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-3dd731b2-46cc-4269-b7b3-68d3946cf36b tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:10:30.703979 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-3dd731b2-46cc-4269-b7b3-68d3946cf36b tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: c5e57f45-cd85-4221-a195-5abaec163b5a] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:10:30.706390 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:10:30.711637 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3dd731b2-46cc-4269-b7b3-68d3946cf36b tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:10:30.712079 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3dd731b2-46cc-4269-b7b3-68d3946cf36b tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:10:30.712835 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3dd731b2-46cc-4269-b7b3-68d3946cf36b tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:10:30.713265 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3dd731b2-46cc-4269-b7b3-68d3946cf36b tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:10:30.718505 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:10:30.728382 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.wsgi [None req-3dd731b2-46cc-4269-b7b3-68d3946cf36b tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] HTTP exception thrown: Instance c5e57f45-cd85-4221-a195-5abaec163b5a could not be found. Jun 03 10:10:30.729920 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-3dd731b2-46cc-4269-b7b3-68d3946cf36b tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Request method failure captured: Jun 03 10:10:30.729920 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: request: DELETE /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a HTTP/1.1 Jun 03 10:10:30.729920 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Accept: application/json Jun 03 10:10:30.729920 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Accept-Encoding: identity Jun 03 10:10:30.729920 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Connection: close Jun 03 10:10:30.729920 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Content-Length: 0 Jun 03 10:10:30.729920 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Content-Type: application/json Jun 03 10:10:30.729920 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Host: 10.222.0.45 Jun 03 10:10:30.729920 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Openstack-System-Scope: None Jun 03 10:10:30.729920 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: User-Agent: python-urllib3/1.26.9 Jun 03 10:10:30.729920 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Auth-Token: gAAAAABimd0c1bQwAMqoi7wOOUGvnF9O4UjSjRQHEkE5OW6dW4Bw9TsHKmezt1mMLiJlWU37Wa_QT7dcGsr104zApmGUxqR3tA_EDsbS0ZfT_2dokn2piNFrjkFG8BqminbczBFSewlGIcNfJbg3ayAM-9tMPQGUQuEGLxFxCBJeVnaARNwHUPw Jun 03 10:10:30.729920 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Domain-Id: None Jun 03 10:10:30.729920 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Domain-Name: None Jun 03 10:10:30.729920 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Identity-Status: Confirmed Jun 03 10:10:30.729920 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Is-Admin-Project: True Jun 03 10:10:30.729920 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Domain-Id: default Jun 03 10:10:30.729920 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Domain-Name: Default Jun 03 10:10:30.729920 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Id: 02a9ee05c1ee47e08b2f7c1601dda3c2 Jun 03 10:10:30.729920 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Project-Name: tempest-AttachVolumeTestJSON-623627224 Jun 03 10:10:30.729920 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Role: member,reader Jun 03 10:10:30.729920 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Roles: member,reader Jun 03 10:10:30.731731 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_02a9ee05c1ee47e08b2f7c1601dda3c2", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/02a9ee05c1ee47e08b2f7c1601dda3c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/02a9ee05c1ee47e08b2f7c1601dda3c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/02a9ee05c1ee47e08b2f7c1601dda3c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 10:10:30.731731 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant: tempest-AttachVolumeTestJSON-623627224 Jun 03 10:10:30.731731 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant-Id: 02a9ee05c1ee47e08b2f7c1601dda3c2 Jun 03 10:10:30.731731 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-Tenant-Name: tempest-AttachVolumeTestJSON-623627224 Jun 03 10:10:30.731731 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User: tempest-AttachVolumeTestJSON-623627224-project Jun 03 10:10:30.731731 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Domain-Id: default Jun 03 10:10:30.731731 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Domain-Name: Default Jun 03 10:10:30.731731 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Id: 617a19a03f4941dd98022cf3f8397fef Jun 03 10:10:30.731731 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: X-User-Name: tempest-AttachVolumeTestJSON-623627224-project Jun 03 10:10:30.731731 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: method: > Jun 03 10:10:30.731731 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: exception: Instance c5e57f45-cd85-4221-a195-5abaec163b5a could not be found. Jun 03 10:10:30.731731 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: action_args: {'id': 'c5e57f45-cd85-4221-a195-5abaec163b5a'} Jun 03 10:10:30.732590 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:10:30.732590 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:10:30.732590 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:10:30.732590 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:10:30.732590 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:10:30.732590 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:10:30.732590 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:10:30.732590 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:10:30.732590 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:10:30.732590 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:10:30.732590 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5e57f45-cd85-4221-a195-5abaec163b5a could not be found. Jun 03 10:10:30.732590 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:10:30.732590 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:10:30.732590 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:10:30.732590 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:10:30.732590 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:10:30.732590 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:10:30.732590 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:10:30.732590 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:10:30.732590 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:10:30.734022 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:10:30.734022 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 03 10:10:30.734022 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 03 10:10:30.734022 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 03 10:10:30.734022 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 03 10:10:30.734022 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:10:30.734022 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:10:30.734022 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:10:30.734022 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:10:30.734022 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5e57f45-cd85-4221-a195-5abaec163b5a could not be found. Jun 03 10:10:30.734022 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:10:30.734022 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:10:30.734022 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:10:30.734022 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:10:30.734022 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:10:30.734022 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:10:30.734022 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:10:30.734022 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:10:30.734022 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5e57f45-cd85-4221-a195-5abaec163b5a could not be found. Jun 03 10:10:30.734022 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR nova.api.openstack.wsgi Jun 03 10:10:30.735432 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-3dd731b2-46cc-4269-b7b3-68d3946cf36b tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Returning 404 to user: Instance c5e57f45-cd85-4221-a195-5abaec163b5a could not be found. {{(pid=117647) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:10:30.735432 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-3dd731b2-46cc-4269-b7b3-68d3946cf36b tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "DELETE /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a" status: 404 len: 111 microversion: 2.1 time: 0.032103 Jun 03 10:10:30.735432 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 635/1229] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jun 3 10:10:30 2022] DELETE /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 10:10:30.739599 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-531e4ac1-1027-49a8-a008-02d091fb851e tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:10:30.740217 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-531e4ac1-1027-49a8-a008-02d091fb851e tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] [instance: c5e57f45-cd85-4221-a195-5abaec163b5a] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:10:30.746651 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-531e4ac1-1027-49a8-a008-02d091fb851e tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:10:30.747097 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-531e4ac1-1027-49a8-a008-02d091fb851e tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:10:30.747855 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-531e4ac1-1027-49a8-a008-02d091fb851e tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:10:30.748291 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-531e4ac1-1027-49a8-a008-02d091fb851e tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:10:30.761146 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.wsgi [None req-531e4ac1-1027-49a8-a008-02d091fb851e tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] HTTP exception thrown: Instance c5e57f45-cd85-4221-a195-5abaec163b5a could not be found. Jun 03 10:10:30.763188 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-531e4ac1-1027-49a8-a008-02d091fb851e tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Request method failure captured: Jun 03 10:10:30.763188 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: request: GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a HTTP/1.1 Jun 03 10:10:30.763188 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept: application/json Jun 03 10:10:30.763188 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept-Encoding: identity Jun 03 10:10:30.763188 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Connection: close Jun 03 10:10:30.763188 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Length: 0 Jun 03 10:10:30.763188 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Type: application/json Jun 03 10:10:30.763188 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Host: 10.222.0.45 Jun 03 10:10:30.763188 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Openstack-System-Scope: None Jun 03 10:10:30.763188 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: User-Agent: python-urllib3/1.26.9 Jun 03 10:10:30.763188 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Auth-Token: gAAAAABimd0c1bQwAMqoi7wOOUGvnF9O4UjSjRQHEkE5OW6dW4Bw9TsHKmezt1mMLiJlWU37Wa_QT7dcGsr104zApmGUxqR3tA_EDsbS0ZfT_2dokn2piNFrjkFG8BqminbczBFSewlGIcNfJbg3ayAM-9tMPQGUQuEGLxFxCBJeVnaARNwHUPw Jun 03 10:10:30.763188 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Id: None Jun 03 10:10:30.763188 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Name: None Jun 03 10:10:30.763188 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Identity-Status: Confirmed Jun 03 10:10:30.763188 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Is-Admin-Project: True Jun 03 10:10:30.763188 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Id: default Jun 03 10:10:30.763188 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Name: Default Jun 03 10:10:30.763188 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Id: 02a9ee05c1ee47e08b2f7c1601dda3c2 Jun 03 10:10:30.763188 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Name: tempest-AttachVolumeTestJSON-623627224 Jun 03 10:10:30.763188 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Role: member,reader Jun 03 10:10:30.763188 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Roles: member,reader Jun 03 10:10:30.764811 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_02a9ee05c1ee47e08b2f7c1601dda3c2", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/02a9ee05c1ee47e08b2f7c1601dda3c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/02a9ee05c1ee47e08b2f7c1601dda3c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/02a9ee05c1ee47e08b2f7c1601dda3c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 10:10:30.764811 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant: tempest-AttachVolumeTestJSON-623627224 Jun 03 10:10:30.764811 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Id: 02a9ee05c1ee47e08b2f7c1601dda3c2 Jun 03 10:10:30.764811 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Name: tempest-AttachVolumeTestJSON-623627224 Jun 03 10:10:30.764811 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User: tempest-AttachVolumeTestJSON-623627224-project Jun 03 10:10:30.764811 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Id: default Jun 03 10:10:30.764811 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Name: Default Jun 03 10:10:30.764811 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Id: 617a19a03f4941dd98022cf3f8397fef Jun 03 10:10:30.764811 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Name: tempest-AttachVolumeTestJSON-623627224-project Jun 03 10:10:30.764811 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: method: > Jun 03 10:10:30.764811 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: exception: Instance c5e57f45-cd85-4221-a195-5abaec163b5a could not be found. Jun 03 10:10:30.764811 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: action_args: {'id': 'c5e57f45-cd85-4221-a195-5abaec163b5a'} Jun 03 10:10:30.765907 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:10:30.765907 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:10:30.765907 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:10:30.765907 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:10:30.765907 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:10:30.765907 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:10:30.765907 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:10:30.765907 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:10:30.765907 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:10:30.765907 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:10:30.765907 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5e57f45-cd85-4221-a195-5abaec163b5a could not be found. Jun 03 10:10:30.765907 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:10:30.765907 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:10:30.765907 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:10:30.765907 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:10:30.765907 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:10:30.765907 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:10:30.765907 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:10:30.765907 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:10:30.765907 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:10:30.767482 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:10:30.767482 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:10:30.767482 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:10:30.767482 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:10:30.767482 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:10:30.767482 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:10:30.767482 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:10:30.767482 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5e57f45-cd85-4221-a195-5abaec163b5a could not be found. Jun 03 10:10:30.767482 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:10:30.767482 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:10:30.767482 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:10:30.767482 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:10:30.767482 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:10:30.767482 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:10:30.767482 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:10:30.767482 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:10:30.767482 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5e57f45-cd85-4221-a195-5abaec163b5a could not be found. Jun 03 10:10:30.767482 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:10:30.768925 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-531e4ac1-1027-49a8-a008-02d091fb851e tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] Returning 404 to user: Instance c5e57f45-cd85-4221-a195-5abaec163b5a could not be found. {{(pid=117648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:10:30.768925 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-531e4ac1-1027-49a8-a008-02d091fb851e tempest-AttachVolumeTestJSON-623627224 tempest-AttachVolumeTestJSON-623627224-project] 10.222.0.45 "GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a" status: 404 len: 111 microversion: 2.1 time: 0.028742 Jun 03 10:10:30.768925 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 595/1230] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:10:30 2022] GET /compute/v2.1/servers/c5e57f45-cd85-4221-a195-5abaec163b5a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 10:11:24.918017 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-d8827085-0dc7-48d6-b135-17db3b5caedd tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-120496783", "imageRef": "0cb3b007-4e95-448b-8acb-895d8acdb244", "flavorRef": "452", "networks": [{"uuid": "68e62abc-0f03-44a5-8cb2-aac972e5beb9"}]}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:11:24.925335 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_api:SELECT=1 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:11:24.970057 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.network.neutron [None req-d8827085-0dc7-48d6-b135-17db3b5caedd tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] validate_networks() for [('68e62abc-0f03-44a5-8cb2-aac972e5beb9', None, None, None, None, None)] {{(pid=117647) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 10:11:25.594515 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-d8827085-0dc7-48d6-b135-17db3b5caedd tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Flavor limits 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 10:11:25.594940 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-d8827085-0dc7-48d6-b135-17db3b5caedd tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Image limits 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 10:11:25.596083 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-d8827085-0dc7-48d6-b135-17db3b5caedd tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Flavor pref 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 10:11:25.596499 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-d8827085-0dc7-48d6-b135-17db3b5caedd tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Image pref 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 10:11:25.596914 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-d8827085-0dc7-48d6-b135-17db3b5caedd tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 10:11:25.605880 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d8827085-0dc7-48d6-b135-17db3b5caedd tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:25.606334 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d8827085-0dc7-48d6-b135-17db3b5caedd tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:25.607133 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d8827085-0dc7-48d6-b135-17db3b5caedd tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:25.607586 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d8827085-0dc7-48d6-b135-17db3b5caedd tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:25.624970 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-d8827085-0dc7-48d6-b135-17db3b5caedd tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Getting quotas for project 0b18f812ac7c4c648bc2c1fb835cf7b2. Resources: {'ram', 'cores', 'instances'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 10:11:25.628937 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-d8827085-0dc7-48d6-b135-17db3b5caedd tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Getting quotas for user 17a5247599bc40c2a1c1893d413f5b42 and project 0b18f812ac7c4c648bc2c1fb835cf7b2. Resources: {'ram', 'cores', 'instances'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 10:11:25.639839 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-d8827085-0dc7-48d6-b135-17db3b5caedd tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Going to run 1 instances... {{(pid=117647) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 10:11:25.642090 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-d8827085-0dc7-48d6-b135-17db3b5caedd tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] [instance: 0ab361a6-376b-4afc-a104-a4bc40fc51cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0cb3b007-4e95-448b-8acb-895d8acdb244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 10:11:25.685564 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d8827085-0dc7-48d6-b135-17db3b5caedd tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] [b8b853da-d4e8-407d-b21a-ba7dfb44a49a] AMQP server on 10.222.0.45:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 03 10:11:26.693444 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO oslo.messaging._drivers.impl_rabbit [None req-d8827085-0dc7-48d6-b135-17db3b5caedd tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] [b8b853da-d4e8-407d-b21a-ba7dfb44a49a] Reconnected to AMQP server on 10.222.0.45:5672 via [amqp] client with port 47232. Jun 03 10:11:26.697336 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-d8827085-0dc7-48d6-b135-17db3b5caedd tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.783756 Jun 03 10:11:26.698026 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 636/1231] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jun 3 10:11:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 10:11:26.708344 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-682bfe88-c096-46e6-9d21-c1b8756e106f tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:11:26.708962 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-682bfe88-c096-46e6-9d21-c1b8756e106f tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] [instance: 0ab361a6-376b-4afc-a104-a4bc40fc51cf] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:11:26.711393 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:11:26.712214 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:11:26.765857 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-682bfe88-c096-46e6-9d21-c1b8756e106f tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5247599bc40c2a1c1893d413f5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18f812ac7c4c648bc2c1fb835cf7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:11:26.773131 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-682bfe88-c096-46e6-9d21-c1b8756e106f tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] 10.222.0.45 "GET /compute/v2.1/servers/0ab361a6-376b-4afc-a104-a4bc40fc51cf" status: 200 len: 1213 microversion: 2.1 time: 0.069156 Jun 03 10:11:26.773690 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 596/1232] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:11:26 2022] GET /compute/v2.1/servers/0ab361a6-376b-4afc-a104-a4bc40fc51cf => generated 1213 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:11:27.790563 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-9919f317-5fa0-4cd2-ba3a-88d1e100340f tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:11:27.791174 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-9919f317-5fa0-4cd2-ba3a-88d1e100340f tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] [instance: 0ab361a6-376b-4afc-a104-a4bc40fc51cf] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:11:27.841280 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-9919f317-5fa0-4cd2-ba3a-88d1e100340f tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5247599bc40c2a1c1893d413f5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18f812ac7c4c648bc2c1fb835cf7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:11:27.849262 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-9919f317-5fa0-4cd2-ba3a-88d1e100340f tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] 10.222.0.45 "GET /compute/v2.1/servers/0ab361a6-376b-4afc-a104-a4bc40fc51cf" status: 200 len: 1213 microversion: 2.1 time: 0.063214 Jun 03 10:11:27.849828 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 637/1233] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:11:27 2022] GET /compute/v2.1/servers/0ab361a6-376b-4afc-a104-a4bc40fc51cf => generated 1213 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:11:28.865346 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-6cff282a-f92d-43b3-ac03-c5acb7505555 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:11:28.866062 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-6cff282a-f92d-43b3-ac03-c5acb7505555 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] [instance: 0ab361a6-376b-4afc-a104-a4bc40fc51cf] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:11:28.922966 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-6cff282a-f92d-43b3-ac03-c5acb7505555 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5247599bc40c2a1c1893d413f5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18f812ac7c4c648bc2c1fb835cf7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:11:28.930252 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-6cff282a-f92d-43b3-ac03-c5acb7505555 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] 10.222.0.45 "GET /compute/v2.1/servers/0ab361a6-376b-4afc-a104-a4bc40fc51cf" status: 200 len: 1213 microversion: 2.1 time: 0.068623 Jun 03 10:11:28.931083 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 597/1234] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:11:28 2022] GET /compute/v2.1/servers/0ab361a6-376b-4afc-a104-a4bc40fc51cf => generated 1213 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:11:29.947789 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-de2b5f66-3ac8-4948-aa70-f2a033df3b82 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:11:29.948439 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-de2b5f66-3ac8-4948-aa70-f2a033df3b82 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] [instance: 0ab361a6-376b-4afc-a104-a4bc40fc51cf] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:11:30.003002 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-de2b5f66-3ac8-4948-aa70-f2a033df3b82 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5247599bc40c2a1c1893d413f5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18f812ac7c4c648bc2c1fb835cf7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:11:30.009247 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-de2b5f66-3ac8-4948-aa70-f2a033df3b82 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] 10.222.0.45 "GET /compute/v2.1/servers/0ab361a6-376b-4afc-a104-a4bc40fc51cf" status: 200 len: 1213 microversion: 2.1 time: 0.065326 Jun 03 10:11:30.009847 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 638/1235] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:11:29 2022] GET /compute/v2.1/servers/0ab361a6-376b-4afc-a104-a4bc40fc51cf => generated 1213 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:11:31.025870 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-862e46b5-7f77-4d7c-a44d-2d9a81584aaf tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:11:31.026493 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-862e46b5-7f77-4d7c-a44d-2d9a81584aaf tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] [instance: 0ab361a6-376b-4afc-a104-a4bc40fc51cf] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:11:31.033464 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-862e46b5-7f77-4d7c-a44d-2d9a81584aaf tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:31.033947 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-862e46b5-7f77-4d7c-a44d-2d9a81584aaf tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:31.034717 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-862e46b5-7f77-4d7c-a44d-2d9a81584aaf tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:31.035161 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-862e46b5-7f77-4d7c-a44d-2d9a81584aaf tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:31.095288 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-862e46b5-7f77-4d7c-a44d-2d9a81584aaf tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5247599bc40c2a1c1893d413f5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18f812ac7c4c648bc2c1fb835cf7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:11:31.103175 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-862e46b5-7f77-4d7c-a44d-2d9a81584aaf tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] 10.222.0.45 "GET /compute/v2.1/servers/0ab361a6-376b-4afc-a104-a4bc40fc51cf" status: 200 len: 1217 microversion: 2.1 time: 0.081146 Jun 03 10:11:31.103740 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 598/1236] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:11:31 2022] GET /compute/v2.1/servers/0ab361a6-376b-4afc-a104-a4bc40fc51cf => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:11:32.120552 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-ce00f136-7904-455b-a190-abe624feeb85 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:11:32.121112 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-ce00f136-7904-455b-a190-abe624feeb85 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] [instance: 0ab361a6-376b-4afc-a104-a4bc40fc51cf] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:11:32.132991 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ce00f136-7904-455b-a190-abe624feeb85 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:32.133482 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ce00f136-7904-455b-a190-abe624feeb85 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:32.134295 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ce00f136-7904-455b-a190-abe624feeb85 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:32.134735 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ce00f136-7904-455b-a190-abe624feeb85 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:32.196829 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-ce00f136-7904-455b-a190-abe624feeb85 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5247599bc40c2a1c1893d413f5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18f812ac7c4c648bc2c1fb835cf7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:11:32.205198 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-ce00f136-7904-455b-a190-abe624feeb85 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] 10.222.0.45 "GET /compute/v2.1/servers/0ab361a6-376b-4afc-a104-a4bc40fc51cf" status: 200 len: 1271 microversion: 2.1 time: 0.088035 Jun 03 10:11:32.206008 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 639/1237] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:11:32 2022] GET /compute/v2.1/servers/0ab361a6-376b-4afc-a104-a4bc40fc51cf => generated 1271 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:11:33.146246 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-f78ad138-fef4-4fce-8471-1ed04952236b req-93dd1547-7bb6-43ca-9a44-c79fd7e50462 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ab361a6-376b-4afc-a104-a4bc40fc51cf", "tag": "9671aafb-d875-4372-9a3a-2f94bc8e1704"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:11:33.156812 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-f78ad138-fef4-4fce-8471-1ed04952236b req-93dd1547-7bb6-43ca-9a44-c79fd7e50462 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:33.158344 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-f78ad138-fef4-4fce-8471-1ed04952236b req-93dd1547-7bb6-43ca-9a44-c79fd7e50462 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:33.171728 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-f78ad138-fef4-4fce-8471-1ed04952236b req-93dd1547-7bb6-43ca-9a44-c79fd7e50462 service nova] Creating event network-changed:9671aafb-d875-4372-9a3a-2f94bc8e1704 for instance 0ab361a6-376b-4afc-a104-a4bc40fc51cf on hv-cinder-79760 Jun 03 10:11:33.177306 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-f78ad138-fef4-4fce-8471-1ed04952236b req-93dd1547-7bb6-43ca-9a44-c79fd7e50462 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035258 Jun 03 10:11:33.178336 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 599/1238] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:11:33.223243 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-bfee4b32-31f7-40c8-a05c-b58e53eec96c tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:11:33.223849 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-bfee4b32-31f7-40c8-a05c-b58e53eec96c tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] [instance: 0ab361a6-376b-4afc-a104-a4bc40fc51cf] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:11:33.230532 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bfee4b32-31f7-40c8-a05c-b58e53eec96c tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:33.230975 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bfee4b32-31f7-40c8-a05c-b58e53eec96c tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:33.231798 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bfee4b32-31f7-40c8-a05c-b58e53eec96c tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:33.232232 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-bfee4b32-31f7-40c8-a05c-b58e53eec96c tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:33.364267 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-bfee4b32-31f7-40c8-a05c-b58e53eec96c tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5247599bc40c2a1c1893d413f5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18f812ac7c4c648bc2c1fb835cf7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:11:33.371898 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-bfee4b32-31f7-40c8-a05c-b58e53eec96c tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] 10.222.0.45 "GET /compute/v2.1/servers/0ab361a6-376b-4afc-a104-a4bc40fc51cf" status: 200 len: 1313 microversion: 2.1 time: 0.152939 Jun 03 10:11:33.372561 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 640/1239] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:11:33 2022] GET /compute/v2.1/servers/0ab361a6-376b-4afc-a104-a4bc40fc51cf => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:11:34.389512 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-175a76d1-445a-4228-bbc6-4336d5364355 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:11:34.390240 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-175a76d1-445a-4228-bbc6-4336d5364355 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] [instance: 0ab361a6-376b-4afc-a104-a4bc40fc51cf] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:11:34.396548 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-175a76d1-445a-4228-bbc6-4336d5364355 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:34.396990 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-175a76d1-445a-4228-bbc6-4336d5364355 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:34.397739 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-175a76d1-445a-4228-bbc6-4336d5364355 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:34.398193 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-175a76d1-445a-4228-bbc6-4336d5364355 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:34.524262 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-175a76d1-445a-4228-bbc6-4336d5364355 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5247599bc40c2a1c1893d413f5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18f812ac7c4c648bc2c1fb835cf7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:11:34.531899 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-175a76d1-445a-4228-bbc6-4336d5364355 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] 10.222.0.45 "GET /compute/v2.1/servers/0ab361a6-376b-4afc-a104-a4bc40fc51cf" status: 200 len: 1313 microversion: 2.1 time: 0.146944 Jun 03 10:11:34.532458 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 600/1240] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:11:34 2022] GET /compute/v2.1/servers/0ab361a6-376b-4afc-a104-a4bc40fc51cf => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:11:35.549476 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-dfa95e3b-8e43-41b1-b7c3-b964d2ccb689 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:11:35.550128 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-dfa95e3b-8e43-41b1-b7c3-b964d2ccb689 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] [instance: 0ab361a6-376b-4afc-a104-a4bc40fc51cf] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:11:35.556782 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-dfa95e3b-8e43-41b1-b7c3-b964d2ccb689 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:35.557232 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-dfa95e3b-8e43-41b1-b7c3-b964d2ccb689 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:35.558022 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-dfa95e3b-8e43-41b1-b7c3-b964d2ccb689 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:35.558462 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-dfa95e3b-8e43-41b1-b7c3-b964d2ccb689 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:35.616187 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell0:SELECT=2 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:11:35.687089 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-dfa95e3b-8e43-41b1-b7c3-b964d2ccb689 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5247599bc40c2a1c1893d413f5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18f812ac7c4c648bc2c1fb835cf7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:11:35.695077 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-dfa95e3b-8e43-41b1-b7c3-b964d2ccb689 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] 10.222.0.45 "GET /compute/v2.1/servers/0ab361a6-376b-4afc-a104-a4bc40fc51cf" status: 200 len: 1313 microversion: 2.1 time: 0.149438 Jun 03 10:11:35.695648 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 641/1241] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:11:35 2022] GET /compute/v2.1/servers/0ab361a6-376b-4afc-a104-a4bc40fc51cf => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:11:36.711197 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-34664f05-6786-42c9-8d3e-ffa353935700 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:11:36.711817 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-34664f05-6786-42c9-8d3e-ffa353935700 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] [instance: 0ab361a6-376b-4afc-a104-a4bc40fc51cf] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:11:36.718417 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-34664f05-6786-42c9-8d3e-ffa353935700 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:36.718870 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-34664f05-6786-42c9-8d3e-ffa353935700 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:36.719635 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-34664f05-6786-42c9-8d3e-ffa353935700 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:36.720075 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-34664f05-6786-42c9-8d3e-ffa353935700 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:36.848086 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-34664f05-6786-42c9-8d3e-ffa353935700 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5247599bc40c2a1c1893d413f5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18f812ac7c4c648bc2c1fb835cf7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:11:36.855493 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-34664f05-6786-42c9-8d3e-ffa353935700 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] 10.222.0.45 "GET /compute/v2.1/servers/0ab361a6-376b-4afc-a104-a4bc40fc51cf" status: 200 len: 1313 microversion: 2.1 time: 0.148104 Jun 03 10:11:36.856056 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 601/1242] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:11:36 2022] GET /compute/v2.1/servers/0ab361a6-376b-4afc-a104-a4bc40fc51cf => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:11:37.873093 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-c91b95ba-b4e5-4c11-92b9-65d7f6ec2a88 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:11:37.873720 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-c91b95ba-b4e5-4c11-92b9-65d7f6ec2a88 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] [instance: 0ab361a6-376b-4afc-a104-a4bc40fc51cf] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:11:37.881914 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c91b95ba-b4e5-4c11-92b9-65d7f6ec2a88 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:37.882366 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c91b95ba-b4e5-4c11-92b9-65d7f6ec2a88 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:37.883133 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c91b95ba-b4e5-4c11-92b9-65d7f6ec2a88 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:37.883960 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-c91b95ba-b4e5-4c11-92b9-65d7f6ec2a88 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:38.007825 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-c91b95ba-b4e5-4c11-92b9-65d7f6ec2a88 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5247599bc40c2a1c1893d413f5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18f812ac7c4c648bc2c1fb835cf7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:11:38.015178 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-c91b95ba-b4e5-4c11-92b9-65d7f6ec2a88 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] 10.222.0.45 "GET /compute/v2.1/servers/0ab361a6-376b-4afc-a104-a4bc40fc51cf" status: 200 len: 1313 microversion: 2.1 time: 0.145940 Jun 03 10:11:38.015748 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 642/1243] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:11:37 2022] GET /compute/v2.1/servers/0ab361a6-376b-4afc-a104-a4bc40fc51cf => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:11:38.197668 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-ddc29e2e-7c35-405a-b080-e14eb75a8fd2 req-b68f297f-e619-41e4-abd0-12f9cbc216d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ab361a6-376b-4afc-a104-a4bc40fc51cf", "name": "network-vif-plugged", "status": "completed", "tag": "9671aafb-d875-4372-9a3a-2f94bc8e1704"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:11:38.206986 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-ddc29e2e-7c35-405a-b080-e14eb75a8fd2 req-b68f297f-e619-41e4-abd0-12f9cbc216d8 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:38.207534 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-ddc29e2e-7c35-405a-b080-e14eb75a8fd2 req-b68f297f-e619-41e4-abd0-12f9cbc216d8 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:38.218863 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-ddc29e2e-7c35-405a-b080-e14eb75a8fd2 req-b68f297f-e619-41e4-abd0-12f9cbc216d8 service nova] Creating event network-vif-plugged:9671aafb-d875-4372-9a3a-2f94bc8e1704 for instance 0ab361a6-376b-4afc-a104-a4bc40fc51cf on hv-cinder-79760 Jun 03 10:11:38.224420 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-ddc29e2e-7c35-405a-b080-e14eb75a8fd2 req-b68f297f-e619-41e4-abd0-12f9cbc216d8 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030349 Jun 03 10:11:38.224999 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 602/1244] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:11:39.032368 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-9aaf7c88-9ab9-4f79-b11e-314f87d1de8b tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:11:39.032989 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-9aaf7c88-9ab9-4f79-b11e-314f87d1de8b tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] [instance: 0ab361a6-376b-4afc-a104-a4bc40fc51cf] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:11:39.040272 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9aaf7c88-9ab9-4f79-b11e-314f87d1de8b tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:39.040726 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9aaf7c88-9ab9-4f79-b11e-314f87d1de8b tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:39.041496 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9aaf7c88-9ab9-4f79-b11e-314f87d1de8b tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:39.041969 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-9aaf7c88-9ab9-4f79-b11e-314f87d1de8b tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:39.181846 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-9aaf7c88-9ab9-4f79-b11e-314f87d1de8b tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5247599bc40c2a1c1893d413f5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18f812ac7c4c648bc2c1fb835cf7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:11:39.191009 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-9aaf7c88-9ab9-4f79-b11e-314f87d1de8b tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] 10.222.0.45 "GET /compute/v2.1/servers/0ab361a6-376b-4afc-a104-a4bc40fc51cf" status: 200 len: 1313 microversion: 2.1 time: 0.162539 Jun 03 10:11:39.191571 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 643/1245] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:11:39 2022] GET /compute/v2.1/servers/0ab361a6-376b-4afc-a104-a4bc40fc51cf => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:11:40.204917 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell0:SELECT=4 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:11:40.210537 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-da4b3265-21b0-42a9-8924-c545e560f923 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:11:40.211231 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-da4b3265-21b0-42a9-8924-c545e560f923 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] [instance: 0ab361a6-376b-4afc-a104-a4bc40fc51cf] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:11:40.217671 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-da4b3265-21b0-42a9-8924-c545e560f923 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:40.218143 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-da4b3265-21b0-42a9-8924-c545e560f923 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:40.218889 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-da4b3265-21b0-42a9-8924-c545e560f923 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:40.219317 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-da4b3265-21b0-42a9-8924-c545e560f923 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:40.346914 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-da4b3265-21b0-42a9-8924-c545e560f923 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5247599bc40c2a1c1893d413f5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18f812ac7c4c648bc2c1fb835cf7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:11:40.355068 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-da4b3265-21b0-42a9-8924-c545e560f923 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] 10.222.0.45 "GET /compute/v2.1/servers/0ab361a6-376b-4afc-a104-a4bc40fc51cf" status: 200 len: 1497 microversion: 2.1 time: 0.150900 Jun 03 10:11:40.355657 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 603/1246] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:11:40 2022] GET /compute/v2.1/servers/0ab361a6-376b-4afc-a104-a4bc40fc51cf => generated 1497 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:11:40.827168 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-833b64dc-5acf-4857-bde8-b7396af2871b tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:11:40.827668 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-833b64dc-5acf-4857-bde8-b7396af2871b tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] [instance: 0ab361a6-376b-4afc-a104-a4bc40fc51cf] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:11:40.829484 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell0:SELECT=10 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:11:40.836242 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-833b64dc-5acf-4857-bde8-b7396af2871b tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:40.836691 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-833b64dc-5acf-4857-bde8-b7396af2871b tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:40.837463 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-833b64dc-5acf-4857-bde8-b7396af2871b tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:40.837985 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-833b64dc-5acf-4857-bde8-b7396af2871b tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:40.864458 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-833b64dc-5acf-4857-bde8-b7396af2871b tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] [instance: 0ab361a6-376b-4afc-a104-a4bc40fc51cf] Going to try to terminate instance {{(pid=117647) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 10:11:40.939094 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-833b64dc-5acf-4857-bde8-b7396af2871b tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] 10.222.0.45 "DELETE /compute/v2.1/servers/0ab361a6-376b-4afc-a104-a4bc40fc51cf" status: 204 len: 0 microversion: 2.1 time: 0.115320 Jun 03 10:11:40.939843 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 644/1247] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jun 3 10:11:40 2022] DELETE /compute/v2.1/servers/0ab361a6-376b-4afc-a104-a4bc40fc51cf => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 10:11:40.948750 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-1a4762a6-e016-42ef-90f0-426d6e59b43c tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:11:40.949368 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-1a4762a6-e016-42ef-90f0-426d6e59b43c tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] [instance: 0ab361a6-376b-4afc-a104-a4bc40fc51cf] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:11:40.955392 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1a4762a6-e016-42ef-90f0-426d6e59b43c tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:40.955845 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1a4762a6-e016-42ef-90f0-426d6e59b43c tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:40.956616 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1a4762a6-e016-42ef-90f0-426d6e59b43c tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:40.957053 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-1a4762a6-e016-42ef-90f0-426d6e59b43c tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:41.086934 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-1a4762a6-e016-42ef-90f0-426d6e59b43c tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5247599bc40c2a1c1893d413f5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18f812ac7c4c648bc2c1fb835cf7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:11:41.094365 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-1a4762a6-e016-42ef-90f0-426d6e59b43c tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] 10.222.0.45 "GET /compute/v2.1/servers/0ab361a6-376b-4afc-a104-a4bc40fc51cf" status: 200 len: 1503 microversion: 2.1 time: 0.149503 Jun 03 10:11:41.094930 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 604/1248] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:11:40 2022] GET /compute/v2.1/servers/0ab361a6-376b-4afc-a104-a4bc40fc51cf => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:11:42.111801 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-d4825a0e-2b82-494b-82d1-1e0033bc64ec tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:11:42.112442 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-d4825a0e-2b82-494b-82d1-1e0033bc64ec tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] [instance: 0ab361a6-376b-4afc-a104-a4bc40fc51cf] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:11:42.119483 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d4825a0e-2b82-494b-82d1-1e0033bc64ec tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:42.119934 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d4825a0e-2b82-494b-82d1-1e0033bc64ec tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:42.120705 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d4825a0e-2b82-494b-82d1-1e0033bc64ec tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:42.121145 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-d4825a0e-2b82-494b-82d1-1e0033bc64ec tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:42.248670 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-d4825a0e-2b82-494b-82d1-1e0033bc64ec tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5247599bc40c2a1c1893d413f5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18f812ac7c4c648bc2c1fb835cf7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:11:42.256130 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-d4825a0e-2b82-494b-82d1-1e0033bc64ec tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] 10.222.0.45 "GET /compute/v2.1/servers/0ab361a6-376b-4afc-a104-a4bc40fc51cf" status: 200 len: 1503 microversion: 2.1 time: 0.148634 Jun 03 10:11:42.256704 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 645/1249] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:11:42 2022] GET /compute/v2.1/servers/0ab361a6-376b-4afc-a104-a4bc40fc51cf => generated 1503 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:11:43.043495 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-a8d192f9-4c27-46a2-985f-b27a5c0bb9a5 req-b7979e26-d759-492b-97b0-08b384983ad5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ab361a6-376b-4afc-a104-a4bc40fc51cf", "name": "network-vif-deleted", "tag": "9671aafb-d875-4372-9a3a-2f94bc8e1704"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:11:43.052567 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-a8d192f9-4c27-46a2-985f-b27a5c0bb9a5 req-b7979e26-d759-492b-97b0-08b384983ad5 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:43.053113 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-a8d192f9-4c27-46a2-985f-b27a5c0bb9a5 req-b7979e26-d759-492b-97b0-08b384983ad5 service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:43.074357 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-a8d192f9-4c27-46a2-985f-b27a5c0bb9a5 req-b7979e26-d759-492b-97b0-08b384983ad5 service nova] Creating event network-vif-deleted:9671aafb-d875-4372-9a3a-2f94bc8e1704 for instance 0ab361a6-376b-4afc-a104-a4bc40fc51cf on hv-cinder-79760 Jun 03 10:11:43.080173 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-a8d192f9-4c27-46a2-985f-b27a5c0bb9a5 req-b7979e26-d759-492b-97b0-08b384983ad5 service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040311 Jun 03 10:11:43.080776 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 605/1250] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 03 10:11:43.273209 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-2cf7368c-247d-4c1d-aecb-34d2155f0ef9 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:11:43.273886 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-2cf7368c-247d-4c1d-aecb-34d2155f0ef9 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] [instance: 0ab361a6-376b-4afc-a104-a4bc40fc51cf] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:11:43.280537 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2cf7368c-247d-4c1d-aecb-34d2155f0ef9 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:43.280986 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2cf7368c-247d-4c1d-aecb-34d2155f0ef9 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:43.281740 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2cf7368c-247d-4c1d-aecb-34d2155f0ef9 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:43.282239 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2cf7368c-247d-4c1d-aecb-34d2155f0ef9 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:43.313080 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2cf7368c-247d-4c1d-aecb-34d2155f0ef9 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:43.313530 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-2cf7368c-247d-4c1d-aecb-34d2155f0ef9 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:43.314006 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.objects.instance [None req-2cf7368c-247d-4c1d-aecb-34d2155f0ef9 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lazy-loading 'fault' on Instance uuid 0ab361a6-376b-4afc-a104-a4bc40fc51cf {{(pid=117647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:11:43.353669 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-2cf7368c-247d-4c1d-aecb-34d2155f0ef9 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5247599bc40c2a1c1893d413f5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18f812ac7c4c648bc2c1fb835cf7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:11:43.361039 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-2cf7368c-247d-4c1d-aecb-34d2155f0ef9 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] 10.222.0.45 "GET /compute/v2.1/servers/0ab361a6-376b-4afc-a104-a4bc40fc51cf" status: 200 len: 1303 microversion: 2.1 time: 0.092161 Jun 03 10:11:43.361601 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 646/1251] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:11:43 2022] GET /compute/v2.1/servers/0ab361a6-376b-4afc-a104-a4bc40fc51cf => generated 1303 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:11:44.379279 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-4ab4a4bc-511a-42c7-94ed-cee230e838c8 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:11:44.379979 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-4ab4a4bc-511a-42c7-94ed-cee230e838c8 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] [instance: 0ab361a6-376b-4afc-a104-a4bc40fc51cf] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:11:44.386238 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4ab4a4bc-511a-42c7-94ed-cee230e838c8 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:44.386683 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4ab4a4bc-511a-42c7-94ed-cee230e838c8 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:44.387438 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4ab4a4bc-511a-42c7-94ed-cee230e838c8 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:44.387867 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-4ab4a4bc-511a-42c7-94ed-cee230e838c8 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:44.400823 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.wsgi [None req-4ab4a4bc-511a-42c7-94ed-cee230e838c8 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] HTTP exception thrown: Instance 0ab361a6-376b-4afc-a104-a4bc40fc51cf could not be found. Jun 03 10:11:44.402436 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-4ab4a4bc-511a-42c7-94ed-cee230e838c8 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Request method failure captured: Jun 03 10:11:44.402436 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: request: GET /compute/v2.1/servers/0ab361a6-376b-4afc-a104-a4bc40fc51cf HTTP/1.1 Jun 03 10:11:44.402436 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept: application/json Jun 03 10:11:44.402436 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept-Encoding: identity Jun 03 10:11:44.402436 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Connection: close Jun 03 10:11:44.402436 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Length: 0 Jun 03 10:11:44.402436 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Type: application/json Jun 03 10:11:44.402436 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Host: 10.222.0.45 Jun 03 10:11:44.402436 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Openstack-System-Scope: None Jun 03 10:11:44.402436 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: User-Agent: python-urllib3/1.26.9 Jun 03 10:11:44.402436 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Auth-Token: gAAAAABimd5L9DJ6t5T6VYaXzykFfSlgXKgLTVgc_LfN5D_xa-R-TRA7P_AYT6B1Lpn3Kup4kwLzN85T_Nf52pCO6aOQve477WfRdgPjjMTDQqaCg1bnrAaVUhbLqaxRFHT2F3JiWcff91bmRcSWO8FivR4RRrAZDFxj9vbhNwNY61ay6BO0MKo Jun 03 10:11:44.402436 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Id: None Jun 03 10:11:44.402436 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Name: None Jun 03 10:11:44.402436 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Identity-Status: Confirmed Jun 03 10:11:44.402436 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Is-Admin-Project: True Jun 03 10:11:44.402436 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Id: default Jun 03 10:11:44.402436 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Name: Default Jun 03 10:11:44.402436 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Id: 0b18f812ac7c4c648bc2c1fb835cf7b2 Jun 03 10:11:44.402436 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Name: tempest-VolumesActionsTest-824582813 Jun 03 10:11:44.402436 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Role: member,reader Jun 03 10:11:44.402436 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Roles: member,reader Jun 03 10:11:44.404272 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0b18f812ac7c4c648bc2c1fb835cf7b2", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0b18f812ac7c4c648bc2c1fb835cf7b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0b18f812ac7c4c648bc2c1fb835cf7b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0b18f812ac7c4c648bc2c1fb835cf7b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 10:11:44.404272 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant: tempest-VolumesActionsTest-824582813 Jun 03 10:11:44.404272 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Id: 0b18f812ac7c4c648bc2c1fb835cf7b2 Jun 03 10:11:44.404272 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Name: tempest-VolumesActionsTest-824582813 Jun 03 10:11:44.404272 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User: tempest-VolumesActionsTest-824582813-project Jun 03 10:11:44.404272 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Id: default Jun 03 10:11:44.404272 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Name: Default Jun 03 10:11:44.404272 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Id: 17a5247599bc40c2a1c1893d413f5b42 Jun 03 10:11:44.404272 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Name: tempest-VolumesActionsTest-824582813-project Jun 03 10:11:44.404272 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: method: > Jun 03 10:11:44.404272 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: exception: Instance 0ab361a6-376b-4afc-a104-a4bc40fc51cf could not be found. Jun 03 10:11:44.404272 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: action_args: {'id': '0ab361a6-376b-4afc-a104-a4bc40fc51cf'} Jun 03 10:11:44.405456 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:11:44.405456 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:11:44.405456 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:11:44.405456 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:11:44.405456 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:11:44.405456 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:11:44.405456 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:11:44.405456 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:11:44.405456 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:11:44.405456 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:11:44.405456 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ab361a6-376b-4afc-a104-a4bc40fc51cf could not be found. Jun 03 10:11:44.405456 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:11:44.405456 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:11:44.405456 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:11:44.405456 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:11:44.405456 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:11:44.405456 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:11:44.405456 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:11:44.405456 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:11:44.405456 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:11:44.407367 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:11:44.407367 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:11:44.407367 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:11:44.407367 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:11:44.407367 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:11:44.407367 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:11:44.407367 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:11:44.407367 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ab361a6-376b-4afc-a104-a4bc40fc51cf could not be found. Jun 03 10:11:44.407367 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:11:44.407367 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:11:44.407367 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:11:44.407367 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:11:44.407367 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:11:44.407367 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:11:44.407367 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:11:44.407367 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:11:44.407367 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ab361a6-376b-4afc-a104-a4bc40fc51cf could not be found. Jun 03 10:11:44.407367 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:11:44.408898 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-4ab4a4bc-511a-42c7-94ed-cee230e838c8 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Returning 404 to user: Instance 0ab361a6-376b-4afc-a104-a4bc40fc51cf could not be found. {{(pid=117648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:11:44.408898 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-4ab4a4bc-511a-42c7-94ed-cee230e838c8 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] 10.222.0.45 "GET /compute/v2.1/servers/0ab361a6-376b-4afc-a104-a4bc40fc51cf" status: 404 len: 111 microversion: 2.1 time: 0.029173 Jun 03 10:11:44.408898 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 606/1252] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:11:44 2022] GET /compute/v2.1/servers/0ab361a6-376b-4afc-a104-a4bc40fc51cf => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 10:11:44.452171 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-7e2720e2-ac6c-4213-b1ec-7146b96c9407 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-480390903", "imageRef": "0cb3b007-4e95-448b-8acb-895d8acdb244", "flavorRef": "452", "networks": [{"uuid": "68e62abc-0f03-44a5-8cb2-aac972e5beb9"}]}} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:11:44.501970 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.network.neutron [None req-7e2720e2-ac6c-4213-b1ec-7146b96c9407 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] validate_networks() for [('68e62abc-0f03-44a5-8cb2-aac972e5beb9', None, None, None, None, None)] {{(pid=117647) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 03 10:11:44.831384 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-7e2720e2-ac6c-4213-b1ec-7146b96c9407 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Flavor limits 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 03 10:11:44.832305 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-7e2720e2-ac6c-4213-b1ec-7146b96c9407 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Image limits 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 03 10:11:44.832785 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-7e2720e2-ac6c-4213-b1ec-7146b96c9407 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Flavor pref 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 03 10:11:44.833188 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-7e2720e2-ac6c-4213-b1ec-7146b96c9407 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Image pref 0:0:0 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 03 10:11:44.833594 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.virt.hardware [None req-7e2720e2-ac6c-4213-b1ec-7146b96c9407 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117647) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 03 10:11:44.842394 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7e2720e2-ac6c-4213-b1ec-7146b96c9407 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:44.842836 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7e2720e2-ac6c-4213-b1ec-7146b96c9407 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:44.843621 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7e2720e2-ac6c-4213-b1ec-7146b96c9407 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:44.844053 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-7e2720e2-ac6c-4213-b1ec-7146b96c9407 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:44.860832 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-7e2720e2-ac6c-4213-b1ec-7146b96c9407 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Getting quotas for project 0b18f812ac7c4c648bc2c1fb835cf7b2. Resources: {'ram', 'cores', 'instances'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 03 10:11:44.864948 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.quota [None req-7e2720e2-ac6c-4213-b1ec-7146b96c9407 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Getting quotas for user 17a5247599bc40c2a1c1893d413f5b42 and project 0b18f812ac7c4c648bc2c1fb835cf7b2. Resources: {'ram', 'cores', 'instances'} {{(pid=117647) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 03 10:11:44.876026 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-7e2720e2-ac6c-4213-b1ec-7146b96c9407 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Going to run 1 instances... {{(pid=117647) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 03 10:11:44.878277 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-7e2720e2-ac6c-4213-b1ec-7146b96c9407 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] [instance: 7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='0cb3b007-4e95-448b-8acb-895d8acdb244',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117647) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 03 10:11:44.923359 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-7e2720e2-ac6c-4213-b1ec-7146b96c9407 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] 10.222.0.45 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.474923 Jun 03 10:11:44.924002 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 647/1253] 10.222.0.45 () {60 vars in 1146 bytes} [Fri Jun 3 10:11:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 476 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 03 10:11:44.933690 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-5e685c5d-326c-492f-aa0f-62653851298d tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:11:44.934405 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-5e685c5d-326c-492f-aa0f-62653851298d tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] [instance: 7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:11:44.987068 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-5e685c5d-326c-492f-aa0f-62653851298d tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5247599bc40c2a1c1893d413f5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18f812ac7c4c648bc2c1fb835cf7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:11:44.993739 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-5e685c5d-326c-492f-aa0f-62653851298d tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] 10.222.0.45 "GET /compute/v2.1/servers/7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27" status: 200 len: 1213 microversion: 2.1 time: 0.063723 Jun 03 10:11:44.994265 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 607/1254] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:11:44 2022] GET /compute/v2.1/servers/7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27 => generated 1213 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:11:46.015760 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-b4a7ed87-abe7-4671-90d7-81fdd197d2e3 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:11:46.016386 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-b4a7ed87-abe7-4671-90d7-81fdd197d2e3 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] [instance: 7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:11:46.205880 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-b4a7ed87-abe7-4671-90d7-81fdd197d2e3 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5247599bc40c2a1c1893d413f5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18f812ac7c4c648bc2c1fb835cf7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:11:46.213071 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-b4a7ed87-abe7-4671-90d7-81fdd197d2e3 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] 10.222.0.45 "GET /compute/v2.1/servers/7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27" status: 200 len: 1213 microversion: 2.1 time: 0.206451 Jun 03 10:11:46.213631 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 648/1255] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:11:46 2022] GET /compute/v2.1/servers/7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27 => generated 1213 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:11:47.231461 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-8e3e2f5b-bee2-4832-9e5c-d53915912214 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:11:47.232620 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-8e3e2f5b-bee2-4832-9e5c-d53915912214 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] [instance: 7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:11:47.339863 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-8e3e2f5b-bee2-4832-9e5c-d53915912214 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5247599bc40c2a1c1893d413f5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18f812ac7c4c648bc2c1fb835cf7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:11:47.346543 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-8e3e2f5b-bee2-4832-9e5c-d53915912214 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] 10.222.0.45 "GET /compute/v2.1/servers/7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27" status: 200 len: 1213 microversion: 2.1 time: 0.120698 Jun 03 10:11:47.347094 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 608/1256] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:11:47 2022] GET /compute/v2.1/servers/7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27 => generated 1213 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:11:48.363833 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-3f8a99ec-0688-4e1b-9644-7873973ba5d1 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:11:48.364452 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-3f8a99ec-0688-4e1b-9644-7873973ba5d1 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] [instance: 7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:11:48.371281 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3f8a99ec-0688-4e1b-9644-7873973ba5d1 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:48.371743 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3f8a99ec-0688-4e1b-9644-7873973ba5d1 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:48.372517 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3f8a99ec-0688-4e1b-9644-7873973ba5d1 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:48.373228 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-3f8a99ec-0688-4e1b-9644-7873973ba5d1 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:48.439751 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-3f8a99ec-0688-4e1b-9644-7873973ba5d1 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5247599bc40c2a1c1893d413f5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18f812ac7c4c648bc2c1fb835cf7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:11:48.447910 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-3f8a99ec-0688-4e1b-9644-7873973ba5d1 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] 10.222.0.45 "GET /compute/v2.1/servers/7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27" status: 200 len: 1217 microversion: 2.1 time: 0.088504 Jun 03 10:11:48.448469 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 649/1257] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:11:48 2022] GET /compute/v2.1/servers/7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27 => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:11:49.464384 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-6fd5e0eb-9e16-4ea2-b5a3-0e4d945025e7 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:11:49.464991 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-6fd5e0eb-9e16-4ea2-b5a3-0e4d945025e7 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] [instance: 7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:11:49.472085 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6fd5e0eb-9e16-4ea2-b5a3-0e4d945025e7 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:49.473042 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6fd5e0eb-9e16-4ea2-b5a3-0e4d945025e7 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:49.473819 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6fd5e0eb-9e16-4ea2-b5a3-0e4d945025e7 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:49.474250 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-6fd5e0eb-9e16-4ea2-b5a3-0e4d945025e7 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:49.537899 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-6fd5e0eb-9e16-4ea2-b5a3-0e4d945025e7 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5247599bc40c2a1c1893d413f5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18f812ac7c4c648bc2c1fb835cf7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:11:49.545799 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-6fd5e0eb-9e16-4ea2-b5a3-0e4d945025e7 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] 10.222.0.45 "GET /compute/v2.1/servers/7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27" status: 200 len: 1271 microversion: 2.1 time: 0.085248 Jun 03 10:11:49.546369 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 609/1258] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:11:49 2022] GET /compute/v2.1/servers/7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27 => generated 1271 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:11:50.300266 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-300380b6-58d0-48a4-ae4a-03dbb8af470c req-72ccfa7c-760c-420e-a2f2-0e4c4890d5bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27", "tag": "3a74eb67-fa69-4bdc-8bd4-ea1b6c7a08f2"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:11:50.316615 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-300380b6-58d0-48a4-ae4a-03dbb8af470c req-72ccfa7c-760c-420e-a2f2-0e4c4890d5bb service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:50.317380 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-300380b6-58d0-48a4-ae4a-03dbb8af470c req-72ccfa7c-760c-420e-a2f2-0e4c4890d5bb service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:50.328513 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-300380b6-58d0-48a4-ae4a-03dbb8af470c req-72ccfa7c-760c-420e-a2f2-0e4c4890d5bb service nova] Creating event network-changed:3a74eb67-fa69-4bdc-8bd4-ea1b6c7a08f2 for instance 7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27 on hv-cinder-79760 Jun 03 10:11:50.333263 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-300380b6-58d0-48a4-ae4a-03dbb8af470c req-72ccfa7c-760c-420e-a2f2-0e4c4890d5bb service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036839 Jun 03 10:11:50.333873 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 650/1259] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:11:50.563983 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-8f004deb-58e4-4010-a1d5-08fd8e1d461b tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:11:50.564691 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-8f004deb-58e4-4010-a1d5-08fd8e1d461b tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] [instance: 7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:11:50.573004 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8f004deb-58e4-4010-a1d5-08fd8e1d461b tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:50.573453 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8f004deb-58e4-4010-a1d5-08fd8e1d461b tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:50.574253 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8f004deb-58e4-4010-a1d5-08fd8e1d461b tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:50.574725 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-8f004deb-58e4-4010-a1d5-08fd8e1d461b tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:50.705829 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-8f004deb-58e4-4010-a1d5-08fd8e1d461b tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5247599bc40c2a1c1893d413f5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18f812ac7c4c648bc2c1fb835cf7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:11:50.714027 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-8f004deb-58e4-4010-a1d5-08fd8e1d461b tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] 10.222.0.45 "GET /compute/v2.1/servers/7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27" status: 200 len: 1313 microversion: 2.1 time: 0.154245 Jun 03 10:11:50.714628 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 610/1260] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:11:50 2022] GET /compute/v2.1/servers/7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:11:51.733459 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-dc0cbbfe-bf49-4eae-bb73-ea94da3664f3 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:11:51.734202 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-dc0cbbfe-bf49-4eae-bb73-ea94da3664f3 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] [instance: 7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:11:51.741127 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-dc0cbbfe-bf49-4eae-bb73-ea94da3664f3 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:51.741581 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-dc0cbbfe-bf49-4eae-bb73-ea94da3664f3 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:51.742383 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-dc0cbbfe-bf49-4eae-bb73-ea94da3664f3 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:51.742826 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-dc0cbbfe-bf49-4eae-bb73-ea94da3664f3 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:51.879353 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-dc0cbbfe-bf49-4eae-bb73-ea94da3664f3 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5247599bc40c2a1c1893d413f5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18f812ac7c4c648bc2c1fb835cf7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:11:51.886835 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-dc0cbbfe-bf49-4eae-bb73-ea94da3664f3 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] 10.222.0.45 "GET /compute/v2.1/servers/7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27" status: 200 len: 1313 microversion: 2.1 time: 0.158561 Jun 03 10:11:51.887393 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 651/1261] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:11:51 2022] GET /compute/v2.1/servers/7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:11:52.903559 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-a1060876-a979-4a7a-8a82-282125fa3916 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:11:52.904201 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-a1060876-a979-4a7a-8a82-282125fa3916 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] [instance: 7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:11:52.907145 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 10:11:52.908265 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Fri Jun 3 10:11:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27 (ip 10.222.0.45) !!! Jun 03 10:11:52.914336 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a1060876-a979-4a7a-8a82-282125fa3916 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:52.915191 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a1060876-a979-4a7a-8a82-282125fa3916 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:52.916454 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a1060876-a979-4a7a-8a82-282125fa3916 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:52.917725 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a1060876-a979-4a7a-8a82-282125fa3916 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:53.047187 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-a1060876-a979-4a7a-8a82-282125fa3916 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5247599bc40c2a1c1893d413f5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18f812ac7c4c648bc2c1fb835cf7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:11:53.055059 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-a1060876-a979-4a7a-8a82-282125fa3916 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] 10.222.0.45 "GET /compute/v2.1/servers/7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27" status: 200 len: 1313 microversion: 2.1 time: 0.155371 Jun 03 10:11:53.055629 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 611/1262] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:11:52 2022] GET /compute/v2.1/servers/7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:11:54.072135 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-ffb23aad-0836-4c64-b974-a4419b9bd784 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:11:54.072752 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-ffb23aad-0836-4c64-b974-a4419b9bd784 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] [instance: 7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:11:54.079470 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ffb23aad-0836-4c64-b974-a4419b9bd784 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:54.079922 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ffb23aad-0836-4c64-b974-a4419b9bd784 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:54.080693 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ffb23aad-0836-4c64-b974-a4419b9bd784 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:54.081133 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-ffb23aad-0836-4c64-b974-a4419b9bd784 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:54.210984 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-ffb23aad-0836-4c64-b974-a4419b9bd784 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5247599bc40c2a1c1893d413f5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18f812ac7c4c648bc2c1fb835cf7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:11:54.218469 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-ffb23aad-0836-4c64-b974-a4419b9bd784 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] 10.222.0.45 "GET /compute/v2.1/servers/7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27" status: 200 len: 1313 microversion: 2.1 time: 0.150187 Jun 03 10:11:54.219047 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 652/1263] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:11:54 2022] GET /compute/v2.1/servers/7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:11:55.235435 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-a004179f-5d57-4d31-b0be-a8863f5cec37 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:11:55.236091 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-a004179f-5d57-4d31-b0be-a8863f5cec37 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] [instance: 7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:11:55.242811 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a004179f-5d57-4d31-b0be-a8863f5cec37 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:55.243228 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a004179f-5d57-4d31-b0be-a8863f5cec37 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:55.244004 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a004179f-5d57-4d31-b0be-a8863f5cec37 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:55.244445 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-a004179f-5d57-4d31-b0be-a8863f5cec37 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:55.374591 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-a004179f-5d57-4d31-b0be-a8863f5cec37 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5247599bc40c2a1c1893d413f5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18f812ac7c4c648bc2c1fb835cf7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:11:55.382217 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-a004179f-5d57-4d31-b0be-a8863f5cec37 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] 10.222.0.45 "GET /compute/v2.1/servers/7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27" status: 200 len: 1313 microversion: 2.1 time: 0.150604 Jun 03 10:11:55.382790 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 612/1264] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:11:55 2022] GET /compute/v2.1/servers/7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:11:56.273920 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [req-aa2c1177-8cdc-4f98-8320-96ded55f1b51 req-94b17a6f-b482-46cd-a736-77c634622c7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27", "name": "network-vif-plugged", "status": "completed", "tag": "3a74eb67-fa69-4bdc-8bd4-ea1b6c7a08f2"}]} {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:11:56.277394 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell0:SELECT=2 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:11:56.278759 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell0:SELECT=8 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:11:56.279512 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:11:56.288691 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-aa2c1177-8cdc-4f98-8320-96ded55f1b51 req-94b17a6f-b482-46cd-a736-77c634622c7b service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:56.289397 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [req-aa2c1177-8cdc-4f98-8320-96ded55f1b51 req-94b17a6f-b482-46cd-a736-77c634622c7b service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:56.294227 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG dbcounter [-] [117647] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117647) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:11:56.304074 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.compute.server_external_events [req-aa2c1177-8cdc-4f98-8320-96ded55f1b51 req-94b17a6f-b482-46cd-a736-77c634622c7b service nova] Creating event network-vif-plugged:3a74eb67-fa69-4bdc-8bd4-ea1b6c7a08f2 for instance 7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27 on hv-cinder-79760 Jun 03 10:11:56.309861 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [req-aa2c1177-8cdc-4f98-8320-96ded55f1b51 req-94b17a6f-b482-46cd-a736-77c634622c7b service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039679 Jun 03 10:11:56.310456 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 653/1265] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:11:56.399095 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-18ffa145-76f6-41ed-b6b1-775fcf865be9 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:11:56.399721 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-18ffa145-76f6-41ed-b6b1-775fcf865be9 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] [instance: 7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:11:56.406565 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-18ffa145-76f6-41ed-b6b1-775fcf865be9 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:56.407015 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-18ffa145-76f6-41ed-b6b1-775fcf865be9 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:56.407785 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-18ffa145-76f6-41ed-b6b1-775fcf865be9 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:56.408220 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-18ffa145-76f6-41ed-b6b1-775fcf865be9 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:56.548045 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-18ffa145-76f6-41ed-b6b1-775fcf865be9 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5247599bc40c2a1c1893d413f5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18f812ac7c4c648bc2c1fb835cf7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:11:56.556665 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-18ffa145-76f6-41ed-b6b1-775fcf865be9 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] 10.222.0.45 "GET /compute/v2.1/servers/7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27" status: 200 len: 1313 microversion: 2.1 time: 0.161303 Jun 03 10:11:56.557493 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 613/1266] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:11:56 2022] GET /compute/v2.1/servers/7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:11:57.006602 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 10:11:57.006830 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Fri Jun 3 10:11:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 10:11:57.574041 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-e7518d47-864a-4df0-bec2-798e410d6981 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:11:57.574746 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-e7518d47-864a-4df0-bec2-798e410d6981 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] [instance: 7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:11:57.584216 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e7518d47-864a-4df0-bec2-798e410d6981 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:57.584837 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e7518d47-864a-4df0-bec2-798e410d6981 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:57.585617 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e7518d47-864a-4df0-bec2-798e410d6981 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:57.586081 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-e7518d47-864a-4df0-bec2-798e410d6981 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:57.712858 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-e7518d47-864a-4df0-bec2-798e410d6981 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5247599bc40c2a1c1893d413f5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18f812ac7c4c648bc2c1fb835cf7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:11:57.720379 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-e7518d47-864a-4df0-bec2-798e410d6981 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] 10.222.0.45 "GET /compute/v2.1/servers/7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27" status: 200 len: 1313 microversion: 2.1 time: 0.150499 Jun 03 10:11:57.721196 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 654/1267] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:11:57 2022] GET /compute/v2.1/servers/7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 03 10:11:58.736332 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-e7e4ee6c-aa28-4243-84e3-f6bb4fb42eb4 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:11:58.736947 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-e7e4ee6c-aa28-4243-84e3-f6bb4fb42eb4 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] [instance: 7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:11:58.738872 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell0:SELECT=4 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:11:58.739994 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_api:SELECT=45 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:11:58.745461 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e7e4ee6c-aa28-4243-84e3-f6bb4fb42eb4 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:58.745935 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e7e4ee6c-aa28-4243-84e3-f6bb4fb42eb4 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:58.746695 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e7e4ee6c-aa28-4243-84e3-f6bb4fb42eb4 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:58.747127 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-e7e4ee6c-aa28-4243-84e3-f6bb4fb42eb4 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:58.751225 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG dbcounter [-] [117648] Writing DB stats nova_cell1:SELECT=69 {{(pid=117648) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 03 10:11:58.877863 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-e7e4ee6c-aa28-4243-84e3-f6bb4fb42eb4 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5247599bc40c2a1c1893d413f5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18f812ac7c4c648bc2c1fb835cf7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:11:58.885933 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-e7e4ee6c-aa28-4243-84e3-f6bb4fb42eb4 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] 10.222.0.45 "GET /compute/v2.1/servers/7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27" status: 200 len: 1498 microversion: 2.1 time: 0.153404 Jun 03 10:11:58.886521 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 614/1268] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:11:58 2022] GET /compute/v2.1/servers/7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27 => generated 1498 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:11:59.388457 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-a3f8f9a8-6a26-4fb8-8f12-b4dca3ec3279 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:11:59.389145 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-a3f8f9a8-6a26-4fb8-8f12-b4dca3ec3279 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] [instance: 7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:11:59.395881 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a3f8f9a8-6a26-4fb8-8f12-b4dca3ec3279 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:59.396332 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a3f8f9a8-6a26-4fb8-8f12-b4dca3ec3279 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:59.397092 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a3f8f9a8-6a26-4fb8-8f12-b4dca3ec3279 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:59.397522 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-a3f8f9a8-6a26-4fb8-8f12-b4dca3ec3279 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:59.422269 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-a3f8f9a8-6a26-4fb8-8f12-b4dca3ec3279 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] [instance: 7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27] Going to try to terminate instance {{(pid=117647) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 03 10:11:59.495575 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-a3f8f9a8-6a26-4fb8-8f12-b4dca3ec3279 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] 10.222.0.45 "DELETE /compute/v2.1/servers/7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27" status: 204 len: 0 microversion: 2.1 time: 0.110732 Jun 03 10:11:59.496275 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 655/1269] 10.222.0.45 () {58 vars in 1238 bytes} [Fri Jun 3 10:11:59 2022] DELETE /compute/v2.1/servers/7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 03 10:11:59.504470 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-ebd756c2-6f8e-4aa1-9f05-03ce6c9cde16 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:11:59.505091 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-ebd756c2-6f8e-4aa1-9f05-03ce6c9cde16 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] [instance: 7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:11:59.511118 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ebd756c2-6f8e-4aa1-9f05-03ce6c9cde16 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:59.511570 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ebd756c2-6f8e-4aa1-9f05-03ce6c9cde16 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:59.512334 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ebd756c2-6f8e-4aa1-9f05-03ce6c9cde16 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:11:59.512770 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-ebd756c2-6f8e-4aa1-9f05-03ce6c9cde16 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:11:59.640802 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.policy [None req-ebd756c2-6f8e-4aa1-9f05-03ce6c9cde16 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5247599bc40c2a1c1893d413f5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18f812ac7c4c648bc2c1fb835cf7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117648) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:11:59.648662 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-ebd756c2-6f8e-4aa1-9f05-03ce6c9cde16 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] 10.222.0.45 "GET /compute/v2.1/servers/7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27" status: 200 len: 1504 microversion: 2.1 time: 0.148060 Jun 03 10:11:59.649220 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 615/1270] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:11:59 2022] GET /compute/v2.1/servers/7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27 => generated 1504 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:12:00.666730 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-70fe86e7-4475-4f60-9a2a-cbdd2892a08f tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:12:00.667334 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-70fe86e7-4475-4f60-9a2a-cbdd2892a08f tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] [instance: 7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:12:00.674088 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-70fe86e7-4475-4f60-9a2a-cbdd2892a08f tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:12:00.674545 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-70fe86e7-4475-4f60-9a2a-cbdd2892a08f tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:12:00.675324 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-70fe86e7-4475-4f60-9a2a-cbdd2892a08f tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:12:00.676311 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-70fe86e7-4475-4f60-9a2a-cbdd2892a08f tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:12:00.804205 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-70fe86e7-4475-4f60-9a2a-cbdd2892a08f tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5247599bc40c2a1c1893d413f5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18f812ac7c4c648bc2c1fb835cf7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:12:00.811775 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-70fe86e7-4475-4f60-9a2a-cbdd2892a08f tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] 10.222.0.45 "GET /compute/v2.1/servers/7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27" status: 200 len: 1504 microversion: 2.1 time: 0.149643 Jun 03 10:12:00.812336 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 656/1271] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:12:00 2022] GET /compute/v2.1/servers/7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:12:01.536078 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [req-2fa7fb45-93c6-46f2-9d9f-77d75d410fec req-bbc081ee-a515-47f2-86a6-894011bb9c7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27", "name": "network-vif-deleted", "tag": "3a74eb67-fa69-4bdc-8bd4-ea1b6c7a08f2"}]} {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 03 10:12:01.545143 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-2fa7fb45-93c6-46f2-9d9f-77d75d410fec req-bbc081ee-a515-47f2-86a6-894011bb9c7d service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:12:01.545664 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [req-2fa7fb45-93c6-46f2-9d9f-77d75d410fec req-bbc081ee-a515-47f2-86a6-894011bb9c7d service nova] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:12:01.557267 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.compute.server_external_events [req-2fa7fb45-93c6-46f2-9d9f-77d75d410fec req-bbc081ee-a515-47f2-86a6-894011bb9c7d service nova] Creating event network-vif-deleted:3a74eb67-fa69-4bdc-8bd4-ea1b6c7a08f2 for instance 7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27 on hv-cinder-79760 Jun 03 10:12:01.562209 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [req-2fa7fb45-93c6-46f2-9d9f-77d75d410fec req-bbc081ee-a515-47f2-86a6-894011bb9c7d service nova] 10.222.0.45 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029809 Jun 03 10:12:01.562799 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 616/1272] 10.222.0.45 () {64 vars in 1317 bytes} [Fri Jun 3 10:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 03 10:12:01.828321 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.api.openstack.wsgi [None req-1530af4e-06df-450a-8882-0d7a1e32de04 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Calling method '>' {{(pid=117647) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:12:01.828968 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.compute.api [None req-1530af4e-06df-450a-8882-0d7a1e32de04 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] [instance: 7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27] Fetching instance by UUID {{(pid=117647) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:12:01.836145 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1530af4e-06df-450a-8882-0d7a1e32de04 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:12:01.836597 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1530af4e-06df-450a-8882-0d7a1e32de04 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:12:01.837363 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1530af4e-06df-450a-8882-0d7a1e32de04 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:12:01.837837 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1530af4e-06df-450a-8882-0d7a1e32de04 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:12:01.867974 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1530af4e-06df-450a-8882-0d7a1e32de04 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:12:01.868449 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG oslo_concurrency.lockutils [None req-1530af4e-06df-450a-8882-0d7a1e32de04 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117647) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:12:01.868930 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.objects.instance [None req-1530af4e-06df-450a-8882-0d7a1e32de04 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lazy-loading 'fault' on Instance uuid 7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27 {{(pid=117647) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 03 10:12:01.919563 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: DEBUG nova.policy [None req-1530af4e-06df-450a-8882-0d7a1e32de04 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '17a5247599bc40c2a1c1893d413f5b42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b18f812ac7c4c648bc2c1fb835cf7b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117647) authorize /opt/stack/nova/nova/policy.py:199}} Jun 03 10:12:01.927507 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO nova.api.openstack.requestlog [None req-1530af4e-06df-450a-8882-0d7a1e32de04 tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] 10.222.0.45 "GET /compute/v2.1/servers/7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27" status: 200 len: 1303 microversion: 2.1 time: 0.103032 Jun 03 10:12:01.928063 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: [pid: 117647|app: 0|req: 657/1273] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:12:01 2022] GET /compute/v2.1/servers/7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27 => generated 1303 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 03 10:12:02.945735 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-f36ae3e1-f823-4071-b4eb-aaf6322db60f tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Calling method '>' {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 03 10:12:02.946450 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.compute.api [None req-f36ae3e1-f823-4071-b4eb-aaf6322db60f tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] [instance: 7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27] Fetching instance by UUID {{(pid=117648) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 03 10:12:02.952591 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f36ae3e1-f823-4071-b4eb-aaf6322db60f tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:12:02.953038 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f36ae3e1-f823-4071-b4eb-aaf6322db60f tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:12:02.953810 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f36ae3e1-f823-4071-b4eb-aaf6322db60f tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 03 10:12:02.954243 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG oslo_concurrency.lockutils [None req-f36ae3e1-f823-4071-b4eb-aaf6322db60f tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Lock "2c987095-b86e-48e2-b785-0c700e5d563a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117648) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 03 10:12:02.967676 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.wsgi [None req-f36ae3e1-f823-4071-b4eb-aaf6322db60f tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] HTTP exception thrown: Instance 7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27 could not be found. Jun 03 10:12:02.969234 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-f36ae3e1-f823-4071-b4eb-aaf6322db60f tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Request method failure captured: Jun 03 10:12:02.969234 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: request: GET /compute/v2.1/servers/7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27 HTTP/1.1 Jun 03 10:12:02.969234 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept: application/json Jun 03 10:12:02.969234 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Accept-Encoding: identity Jun 03 10:12:02.969234 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Connection: close Jun 03 10:12:02.969234 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Length: 0 Jun 03 10:12:02.969234 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Content-Type: application/json Jun 03 10:12:02.969234 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Host: 10.222.0.45 Jun 03 10:12:02.969234 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Openstack-System-Scope: None Jun 03 10:12:02.969234 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: User-Agent: python-urllib3/1.26.9 Jun 03 10:12:02.969234 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Auth-Token: gAAAAABimd5L9DJ6t5T6VYaXzykFfSlgXKgLTVgc_LfN5D_xa-R-TRA7P_AYT6B1Lpn3Kup4kwLzN85T_Nf52pCO6aOQve477WfRdgPjjMTDQqaCg1bnrAaVUhbLqaxRFHT2F3JiWcff91bmRcSWO8FivR4RRrAZDFxj9vbhNwNY61ay6BO0MKo Jun 03 10:12:02.969234 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Id: None Jun 03 10:12:02.969234 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Domain-Name: None Jun 03 10:12:02.969234 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Identity-Status: Confirmed Jun 03 10:12:02.969234 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Is-Admin-Project: True Jun 03 10:12:02.969234 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Id: default Jun 03 10:12:02.969234 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Domain-Name: Default Jun 03 10:12:02.969234 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Id: 0b18f812ac7c4c648bc2c1fb835cf7b2 Jun 03 10:12:02.969234 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Project-Name: tempest-VolumesActionsTest-824582813 Jun 03 10:12:02.969234 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Role: member,reader Jun 03 10:12:02.969234 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Roles: member,reader Jun 03 10:12:02.971047 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:8080/v1/AUTH_0b18f812ac7c4c648bc2c1fb835cf7b2", "adminURL": "http://10.222.0.45:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/compute/v2/0b18f812ac7c4c648bc2c1fb835cf7b2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0b18f812ac7c4c648bc2c1fb835cf7b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/volume/v3/0b18f812ac7c4c648bc2c1fb835cf7b2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.45/identity"}]}] Jun 03 10:12:02.971047 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant: tempest-VolumesActionsTest-824582813 Jun 03 10:12:02.971047 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Id: 0b18f812ac7c4c648bc2c1fb835cf7b2 Jun 03 10:12:02.971047 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-Tenant-Name: tempest-VolumesActionsTest-824582813 Jun 03 10:12:02.971047 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User: tempest-VolumesActionsTest-824582813-project Jun 03 10:12:02.971047 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Id: default Jun 03 10:12:02.971047 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Domain-Name: Default Jun 03 10:12:02.971047 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Id: 17a5247599bc40c2a1c1893d413f5b42 Jun 03 10:12:02.971047 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: X-User-Name: tempest-VolumesActionsTest-824582813-project Jun 03 10:12:02.971047 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: method: > Jun 03 10:12:02.971047 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: exception: Instance 7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27 could not be found. Jun 03 10:12:02.971047 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: action_args: {'id': '7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27'} Jun 03 10:12:02.972256 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: {{(pid=117648) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 03 10:12:02.972256 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:12:02.972256 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 03 10:12:02.972256 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 03 10:12:02.972256 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 03 10:12:02.972256 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 03 10:12:02.972256 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 03 10:12:02.972256 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 03 10:12:02.972256 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 03 10:12:02.972256 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 03 10:12:02.972256 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27 could not be found. Jun 03 10:12:02.972256 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:12:02.972256 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:12:02.972256 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:12:02.972256 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:12:02.972256 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:12:02.972256 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:12:02.972256 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 03 10:12:02.972256 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 03 10:12:02.972256 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 03 10:12:02.974099 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 03 10:12:02.974099 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 03 10:12:02.974099 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 03 10:12:02.974099 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 03 10:12:02.974099 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 03 10:12:02.974099 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 03 10:12:02.974099 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 03 10:12:02.974099 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27 could not be found. Jun 03 10:12:02.974099 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:12:02.974099 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 03 10:12:02.974099 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:12:02.974099 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 03 10:12:02.974099 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 03 10:12:02.974099 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 03 10:12:02.974099 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 03 10:12:02.974099 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 03 10:12:02.974099 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27 could not be found. Jun 03 10:12:02.974099 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: ERROR nova.api.openstack.wsgi Jun 03 10:12:02.975796 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: DEBUG nova.api.openstack.wsgi [None req-f36ae3e1-f823-4071-b4eb-aaf6322db60f tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] Returning 404 to user: Instance 7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27 could not be found. {{(pid=117648) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 03 10:12:02.975796 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO nova.api.openstack.requestlog [None req-f36ae3e1-f823-4071-b4eb-aaf6322db60f tempest-VolumesActionsTest-824582813 tempest-VolumesActionsTest-824582813-project] 10.222.0.45 "GET /compute/v2.1/servers/7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27" status: 404 len: 111 microversion: 2.1 time: 0.030000 Jun 03 10:12:02.975796 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: [pid: 117648|app: 0|req: 617/1274] 10.222.0.45 () {58 vars in 1235 bytes} [Fri Jun 3 10:12:02 2022] GET /compute/v2.1/servers/7ee0a5ae-b43b-4a76-be1c-d33ee6a9ea27 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 03 10:13:29.221588 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 10:13:29.222349 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Fri Jun 3 10:13:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 10:15:12.923775 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 10:15:12.924546 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Fri Jun 3 10:15:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 10:15:17.014761 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 10:15:17.015330 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Fri Jun 3 10:15:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 10:16:45.903744 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 10:16:45.904474 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Fri Jun 3 10:16:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 10:16:49.229606 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 10:16:49.230150 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Fri Jun 3 10:16:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 10:17:06.947315 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 10:17:06.947928 dv-cinder-797608-29-iscsi devstack@n-api.service[117647]: Fri Jun 3 10:17:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 03 10:17:11.460133 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 03 10:17:11.460614 dv-cinder-797608-29-iscsi devstack@n-api.service[117648]: Fri Jun 3 10:17:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!